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PREFACE 


e 
THIS BOOK HAS BEEN WRITTEN PRIMARILY FOR THE 
graduate student in Education, but may be useful to educational 
workers who are interested in professional problem-solving or re- 
search in the field. 

While writing a thesis is no longer a prerequisite for the Master's 
degree in Education in most institutions, graduate students are 

- expected to present simple studies and term papers in connection 
with graduate courses. Graduate teacher-students can profitably 
carry on modest research projects that help in finding solutions to 
the countless problems confronting classrooni teachers and school 
administrators. 

All graduate students should be familiar with scholarly research 
in Education; and, if only as consumers, it is important that they 
understand the terminology, the methodology, and the spirit of sys- 
tematic research, and be able to evaluate the published Eu 
reports that are found in professional publications. 

v 


Vi PREFACE 


. The author is aware of the pitfalls inherent in writing a book on 

educational research. On the one hand is the tendency to heaviness 
or dullness that has often characterized scholarly work in this 
area. Since research is a tremendously complex field of activity, 
there is a temptation to attempt a complete treatment, often too 
complex to be of maximum value to beginning students in the 
graduate program in Education. 

On the other hand, in trying to make clear an area of activity 
that is complex, there is the equal danger of presenting a superficial 
picture, with not enough actual aid in how to carry on research 
projects. No matter what one presents, there is likely to be some 

' degree of oversimplification. No textbook can present all of the 
information that would be helpful. 

The author has tried to present the theory and application of 
Educational Research in as clear and concise a manner as possible. 
But no treatment can or should be completely exhaustive, and the 
instructor may want to amplify, illuminate, and supplement cer- 
tain areas of this treatment. 

Any book is the product of the contributions of a number of 
people. The author is indebted to many individuals, more than 
can be acknowledged by name. He is especially indebted to Pro- 
fessor A. S. Barr of the University of Wisconsin for many of the 
basic ideas. Gratitude is also due Dean J. Hartt Walsh, Butler 
University College of Education, for his suggestions and encourage- 
ment, his colleagues for their helpful advice, the many graduate 
students whose reactions to the presentation of these ideas proved 
most helpful, and Butler University for makin 
sible. 

To his wife, Solveig, the author expresses gratitude for her con- 
stant encouragement and forbearance, 


g the project pos- 


J.W.B. 
Indianapolis, Indiana 
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RESEARCH IN 
EDUCATION 


THE MEANING OF.RESEARCH 


o 


FROM THE BEGINNING OF TIME MAN HAS BEEN CURI- 
ous about the world around him. His earliest cfforts to explain 
the operation of the universe resulted in primitive religious con- 
cepts, attributing the mysterious forces of nature to the working of 
supernatural powers who, at their whims, manipulated the sun, the 

stars, the wind, and the rain. 
- . The appearance of the medicine man or the priest who claimed 
special channels of communication with the gods led to the estob- 

1 


" ww 


2 THE MEANING OF RESEARCH 0 


lishment of a rigid system of authority. Explanations of physcial 
phenomena and life's processes were made in terms of mysticism 
and the dogma of the priesthood. : 

But, gradually, man began to see that the operations of the forces 
of nature were not as capricious as he had believed. He began to 
observe a certain orderliness in the universe, certain cause-effect 
relationships, and discovered that under certain conditions, events 
could be predicted with reasonable accuracy. 

But these explanations were rejected if they seemed to conflict 
with the dogma of religious authority. Curious men were punished 
if they persisted in expressing the doubts raised by these dangerous 
and unorthodox beliefs. 

This reliance on empirical evidence or personal experience chal- 
lenged the sanction of vested authority, and represented a step in 
the direction of scientific inquiry. It was largely unsystematic ob- 
servation, however, subject to the limitations of the individual's 
experience and his lack of an objective method. He was likely 
to overgeneralize on the basis of incomplete evidence or experi- 
ence, to ignore complex factors in a situation, cr to let his feelings 
and prejudices condition both his observations and his conclusions. 
It was only when man began to think systematically about thinking 
itself that the era of science really began. 

The first systematic approach to reasoning was through the use 
of the syllogism, attributed to Aristotle and the Greeks, Syllogistic 
reasoning established a logical relationship between a major 
premise, a minor premise, and a conclusion. A major premise is 
a self-evident assumption, previously established by metaphysical 
truth or dogma, concerning a relationship; the minor premise is a 
particular case concerning one of the parts of this relationship; 
given the truth of these premises, they lead to an inescapable con- 
clusion. 


A typical example follows: 


Major Premise—Man is a rational being 
Minor Premise—Edward Jones is a man 
Conclusion—Edward Jones is a rational being. 
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This deductive method of logical analysis made an important 
contribution to the development of the scientific method. 

Centuries later,,Francis Bacon advocated the application of direct 
observation of phenomena, arriving at generalizations or truths from 
the marshalled evidence of many specific observations. This in- 
ductive process of moving from the specific or particular to the gen- 
eral freed logic from some of the hazards and limitetions of 
deductive thinking alone. Bacon recognized the obstacle that the 
deductive process placed in the way of discovering new truths in 
that it started with old dogmas of philosophy and religion that the 
human mind had already accepted. These idols, as he termed 
them, were exposed in his Novum Organum, written in 1620. He 
proposed a new,method of advancing human knowledge, the induc- 
tive process, which formed many direct observations of the phe- 
nomena of the external world into new generalizations. This 
method, new to the field of logic but already widely used by 
scientists, was not hampered by false premises, the inadequacies 
of verbal symbolism, and the absence of supporting evidence. 

But the inductive method alone did not provide a complete sys- 
tem for the solution of probléms. Random collection of individual 
"observations without any amifying concept or goal left investigations 
in a forest of confusion, rarely leading to a logical generalization 
or principle. 

It was Charles Darwin who eventually integrated the deductive 
method of Aristotle with the inductive method of Francis Bacon. 
After many years of collecting data on the variation of plants and 
animals, he arrived at an assumption that natural selection explained 
the origin of species. This theory was supported by his later ob- 
servations. Thus, he was able to verify his generalization by the 
deductive-inductive process, now recognized as the essence of the 
scientific method. 

The scientist starts with an hypothesis or assumption as a guide 
to what type of data to gather. The hypothesis is proven, modified, 
or destroyed in the light of the data. While the scientific method 
of analysis does not always follow the same simple sequence of 
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steps, a pattern is helpful in identifying the elements that com- 
prise the deductive-inductive process. 

l. Identification and definition of the problem. 

2. Formulation of an hypothesis—a hunch, an assumption, or an 
intelligent guess. 

^ .8. Collection, organization, and analysis of data. 

4. Formulation of conclusions. 

5. Verification or rejection of the hypothesis. 

At times, the formulation of the hypothesis may not be completed 
until some data are collected and examined. The scientific investi- 
gator may move back and forth between these steps in the process 
of his analysis of the problem. 


THE SOCIAL SCIENCES 


The term science has come to mean a method or attitude rather 
than a field of subject matter. By attempting to apply the rigorous 
controls of systematic observation and analysis of the physical sci- 
ences to areas of social behavior, the social sciences have developed. 
The fields of anthropology, economics, education, government, psy- 
chology, sociology, and social psychology have become recognized 
as social sciences, at least in the thinking of many authorities, To 
the extent that these areas of study derive their foundations from 
the methodology and spirit of science, they are sciences—social 
sciences. There are those who reject this concept, still defining 
science in terms of areas of subject matter, rather than methodology. 
Historically, this can be readily explained. Since the scientific 
method was first used in the investigation of physical phenomena, 
tradition has identified science with the physical world. Only in 
relatively recent yeers has the methodology of science been applied 
to human behavior. Since these are newer areas of investigation, 
their results have not achieved the acceptance and status that comes 
with maturity and tradition. 

Human behavior is complex. Since individuals differ so much in 
feelings, drives, and motivations, it is difficult to arrive at generaliza- 
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tions with the certainty that is possible in describing aspects of 
inanimate objects. 

Although the problems of discovering principles of human be- 
havior are difficult, they are not impossible. Social scientists will 
need to carry on Óbservations as careful and laborious as those 
that have characterized centuries of effort in the physical sciences. 
Subjective, qualitative judgments must be supplemented by more 
exact, quantitative measurements. Progress is being made, and 
there is little doubt that, in time, we will be able to describe the 
cause-effect relationships of human behavior in much more exact 
terms, perhaps approaching the exactness that characterizes the 
physical sciences. 

Today, we live in a world that attests to the miracles of physical 
Science. Many diseases have been conquered. The Salk vaccine 
promises to rid the world of poliomyelitis. Man’s life-span has been 
increased markedly, actually by almost two-thirds in the past cen- 
tury. Man travels faster than the speed of sound, enjoys a more 
adequate diet, performs less physical labor, and suffers less from 
the discomforts of excessive heat, cold, and humidity. He has con- 
stant entertainmefit available at the click of a switch, and enjoys 


‘more leisure time than he could have dreamed of a century ago. 


The splitting of the atom and the developments in the field of elec- 
tronics promise improvements that are beyond the scope of human 
imagination. All of these improvements have resulted from the 
contributions of physical science. 

But there is less confidence about the improvement of the non- 
physical aspects of our culture. With all of his marvelous gadgets, 
there is some question about whether man is happier, more satis- 
fied, or that his basic needs are more effectively being fulfilled 
today than a century ago. The consequences of hot and cold wars 
and intergroup conflicts have become even more frightening with 
the development of more effective means of destruction. 

It is in the area of the nonmaterial, behavioral aspects of our 
culture that the scientific method must be employed. This lag of 
the behavioral sciences in relation to the physical sciences presents 


Y 
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the most challenging task that confronts twentieth-century man. 
These solutions can only be achieved by application of the scientific 
method to the behavioral areas through research. 


WHAT IS RESEARCH? 


How is research related to the scientific method? The terms 
research and scientific method are often used synonymously in edu- 
cational discussions. Although it is true that the terms have some 
common elements of meaning, a distinction would be helpful. 

( For the purposes of this discussion, research is considered to be 
the more formal, systematic, intensive process of carrying on the 
scientific method of analysis. It involves a more systematic struc- 
ture of investigation, usually resulting in some sort of formal record 
of procedures and a report of results or conclusions. While it is 
possible to employ the scientific spirit without research, it would 
be impossible to engage in sound research without employing the 
scientific method and spirit. Q 

_ Thus, research is a more specialized phase of scientific meth- 
odology.) Many people have a superficial concept of research, pic- 
turing the researcher as a strange, introverted individual who, shun- ^ 
ning the company of his fellows, finds refuge in the intricacies of 
his laboratory. Here, surrounded by test tubes, retorts, beakers, 
and dials, the scientist carries on his mysterious activities. 

In reality, the picture is quite different. Research is not at all 
mysterious, and is carried on by hundreds of thousands of normal 
individuals, more often by teams than alone, very often in the fac- 
tory, school, or community as well as in the laboratory. Its impor- 
tance is attested by the tremendous amount of time, manpower, and 
sums of money spent on research by industry, universities, govern- 
ment, and the proféssions. The “secret” of our cultural develop- 
ment has been research, pushing back the areas of ignorance by 
discovering new truths which, in turn, lead to better ways of doing 
things and new and better products. 

/ We recognize the fruits of research: better products, better foods, 
better ways of preventing and treating'diseases, better ways of 
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understanding the behavior of individuals and groups, and a better 
understanding of the world in which we live. In the field of edu- 
cation, we identify research with a better understanding of the 
teaching-learning process, and the conditions under which it is most 
successfully carried on. 


CHARACTERISTICS OF RESEARCH 


A summary of some of the characteristics of research may clarify 
the concept of its methodology. 

' Research gathers new knowledge or data from primary or first- 

hand sources.* It is not research when one merely restates or reor- 


.ganizes what is already known or what has been written. Re- 


search places emphasis upon the discovery of general principles. 
It goes beyond the specific groups and situations investigated, and, 
by careful sampling procedures, infers qualities of the entire popu- 
lation from those observed in the smaller group. 

Research is expert, systematic, and accurate investigation. The 
researcher knows what is already known about his problem. He 


: proceeds from this poirit, carefully planning his procedures. Data 


are gathered, recorded, and analyzed with as complete accuracy 
as possible.) He uses such valid data-gathering instruments as he 
can find or devise, and employs mechanical means to improve on 
the accuracy of human observation, recording, and computation of 
data. 

Research is logical and objective, applying every possible test to 
verify the data collected and the procedures employed. The re- 
searcher constantly strives to eliminate personal feeling and prefer- 
ence, He resists the temptation to seek only the data that support 
his hypothesis. There is no attempt to persuade or to prove. 
The emphasis is on testing, rather than on proving, the hypothesis. 
The researcher elevates clear thinking and-logic. He suppresses 
feeling and emotion in his analysis. 5 
| Research endeavors to organize data in quantitative terms, if 
possible, and to express them as numerical measures. Research is 
patient and unhurried. The researcher is willing to exert painstak- 
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ing effort, suspending judgment to permit the data and logic to lead 
to a sound conclusion. He realizes that significan? findings do not 
come as a result of hurried and careless procedyres. Research re- 
quires courage." The researcher is willing to follow his pro- 
cedures to conclusions that may be unpopular and bring social dis- 
approval It would seem appropriate to mention several historic 
examples of the penalties that come from conflict with dogmas or 
commonly accepted values. 

The Polish scientist, Copernicus, was condemned by church 
authorities because he announced his conclusion concerning the 
nature of the universe. His theory that the sun, not the earth, 
was the center of the solar system, in direct conflict with the older 
Ptolemaic theory, offended supporters of prevailing religious dogma, 
who viewed his theory as a denial of the story of creation as por- 
trayed in the book of Genesis. 

The late Dr. Albert Kinsey, of Indiana University, who studied 

the sexual behavior of the American male and the American female, 
saw his work arouse violent criticism from those, whose personal 
experiences or observations were in conflict with the evidence, or 
who felt that his area of investigation and methodology inappro- 
priate or in poor taste. 
\ Research is carefully recorded and reported. Every term is care- 
fully defined, all procedures are described in detail, all limiting fac- 
tors are recognized, all references are carefully documented, and 
all results are objectively recorded. All conclusions and generaliza- 
tions are cautiously arrived at, with due consideration for all of the 
limitations of methodology, data collected, and errors of human 
interpretation. ) 

The rigorous standards of scientific research are apparent from 
an examination of these characteristics, The research worker must 
be a scholarly, imaginative person of the highest integrity, willing 
to spend long hours pajnstakingly seeking the truth. 


FUNDAMENTAL RESEARCH AND ACTION RESEARCH 


The discussion to this point has described research in its more 
formal aspects. It has drawn its pattern and spirit from the physical 
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sciences, and has represented a rigorous, structured type of analysis. 
The purpose of this kind of research has been to develop theories 
by discovering broad generalizations or principles. It has employed 
careful sampling procedures in order to extend the findings beyond 
the group or situation studied. It has had little concern for the 
application of the findings, an area which has been considered to 
be the concern of someone other than the investigator. Some have 
termed this methodology the approach of pure research. A more 
common designation is fundamental research. 

During the past twenty to twenty-five years there has been a 
growing emphasis in social psychology and education on what is 
known as applied or action research. In education this newer 
approach has had as its goal the involvement of both research 
specialist and classroom teacher in the study and application of 
research to educational problems in the community, school, or class- 
room, in a particular setting. Advocates of action research have 
pointed out that fundamental research has never interested more 
than a small proportion of teachers,*and then only as casual con- 
sumers or spectators, rather than as active participants. This group 


‘has declared fundamental research to be appropriate only when 


dealing with such problems as the learning processes of white rats 
in the psychological laboratory. But what of its practicability in 
studying and trying to improve the complex learning process of a 
group of students in a classroom? They have charged fundamental 
research with a failure to make a significant contribution to “grass- 
roots" education, for, with all of its scientific methodology, teachers 
have not been able to recognize its application to their everyday 
classroom problems. 

Stephen M. Corey, a leader in the field of action research, states 
the case in this way: ! 


. I have lost much of the faith I once had in the consequences of 


~ asking only the professional educational investigator to study the schools 


and to recommend what they should do. Incorporating these recom- 
mendations into the behavior-pattern of practitioners involve$ some prob- 


1 Stephen M. Corey, Action Research to Improve School Practices. (New 
York: Bureau of Publications, Teachers College, Columbia Vevey: 1953), 
p. vii, Used with permission of the publisher. 
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lems that so far have been insoluable . . . Most of the study of what 
should be kept in the schools and what should go and what should be 
added must be done in hundreds of thousands of classrooms and thou- 
sands of American communities. The studies must be undertaken by 
those who may have to change the way they do things as a result of the 
studies. Our schools cannot keep up with the life they are supposed 
to sustain and improve unless teachers, pupils, supervisors, administrators, 
and school patrons continuously examine what they are doing. Singly 
and in groups, they must use their imaginations creatively and construc- 
tively to identify the practices that must be changed to meet the needs 
and demands of modern life, courageously try out those practices that 
give better promise, and methodically and systematically gather evidence 
to test their worth. 


This is the process I call action research. I hold no special brief for 
the name but it has some currency and is sufficiently descriptive. What 
I will talk about is research that is undertaken by educational practi- 
tioners because they believe that by so doing they can make better deci- 
sions and engage in better actions. 


Action research is focused on the immediate application, not on 
the development, of theory. It has placed its emphasis on a real 


problem—here and now in a local setting» Its findings are to be 


evaluated in terms of local applicability, not in terms of universal 
validity. Its advocates propose that research be the function of 
groups of teachers, with research specialists serving either as con- 
sultants or as members of the research team. This method provides 
sufficient flexibility to permit modification of the hypotheses and 
procedures as the study goes on. Its purpose is to improve school 
practices and, at the same time, to improve those who are to im- 
prove the practices. The purpose is to combine the research 
function with teacher growth in such qualities as objectivity, skill 
in research processes, habits of thinking, ability to work harmoni- 
ously with others, and professional spirit. 

-Is there a conflict between fundamental research and action re- 
search? Actually, there is none. The difference is in emphasis, not 
in method or spirit. Each type is committed to the high standards 
of scientific objectivity and scholarship. The graduate student 
should understand and appreciate fundamental research as part of 
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his professional training, and should understand that sound educa- 
tional theory is bpilt on fundamental research. No vocation can be 
a profession unless its great body of knowledge is based upon sound 
theory which, in turn, comes from fundamental research. Teachers 
should be familiar with the findings of fundamental research, par- 
ticularly in their areas of specialization. Without this understand- 
ing they are merely mechanics or craftsmen, and have no right to 
be considered professional practitioners. 

It is not likely, however, that many public school teachers will 
engage in the more formal aspects of research activity. While 
fundamental research will continue to make its essential contribution 
to professional education, it will be largely the function of doctoral 
candidates and subsidized research specialists in universities, pri- 
vate and government social agencies, professional associations, 
foundations, and the larger school systems. 

If classroom teachers are to make an active research contribution, 
it will probably be in the area of action research. Studies will be 
made for the purpose of improving» local school practices. Many 
educational observers see in àction research one of the most promis- 

" ing avenues for teacher growth, professional improvement, and the 
development of a better curriculum. 


TYPES OF EDUCATIONAL RESEARCH 


Any attempt to classify types of educational research poses a diffi- 
cult problem. The fact that practically every textbook presents a 
different system of classification provides convincing evidence that 
there is no generally accepted scheme. 

To systematize a method of presentation, however, some pattern 
is necessary. At the risk of seeming arbitrary, a framework is sug- 
gested that might simplify understanding of basic principles of 
research methodology. It should be remembered that the system 
of classification is not important in itself, but only has value in mak- 
ing the analysis of research processes more comprehensible. 

Actually, all research involves observation and description, the 
description of what happens under certain circumstances. A rather 
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simple three-point analysis may be used to classify educational 
research. Practically all studies fall under one pr a combination 
of these types. 

1. Historical Research describes what was. ‘the process involves 
investigating, recording, analyzing, and interpreting the events of 
the past for the purpose of discovering generalizations that are help- 
ful in understanding the present and in predicting the future. The 
focus of historical research is on change, growth, or development 
of individuals, groups, practices, movements, institutions, or ideas. 
Historical research attempts to go back to primary, original, or first- 
hand sources of information. 

2. Descriptive research describes what is. It involves the de- 
scription, recording, analysis, and interpretation of the present 
nature, composition, or processes of phenomena. The focus is on 
prevailing conditions, or on how a person, group, or thing behaves 
or functions in the present. It often involves some type of com- 
parison or contrast. 

3. Experimental research describes what will be when certain 
factors are carefully controlled. The focus is on cause-effect rela- 
tionships; variables are carefully manipulated for the purpose of 
determining their influence. 

À. complete chapter is devoted to each of these three types of 


research; techniques of data gathering and areas of application are 
carefully considered. 


SUMMARY 


Man's desire to know about his world has led him from primitive 
superstition to modern scientific knowledge. From mysticism, 
dogma, and the limitations of unsystematic observation based upon 
personal experience, he has examined the process of thinking itself 
to develop the methods of deductive and inductive reasoning which 
have become the essence of scientific inquiry. 

Although first applied as the methodology of the physical sciences, 
the process of scientific inquiry has become useful in the study of 
human behavior, resulting in the social sciences. The great chal- 
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lenge of the twentieth century calls for greater understanding of 
man and his behavior. 

Fundamental resesrch is the formal and systematic process of 
carrying on the scientific method of analysis and generalization, the 
deductive and inductive phases of reasoning. Fundamental re- 
search has increased and will continue to increase understanding 
of the teaching-learning process and the conditions under which 
it is most successfully carried on. 

Action research, employing the spirit of fundamental research, 
has focused attention upon the solution of problems, rather than 
upon the formulation of theories. It is concerned with a particular 
group, rather than with people in general It is concerned with 
immediate results, and is interested in the growth of the individ- 
uals involved in the research process. Action research appeals to 
teachers and other busy professional workers who have problems 
to solve. While there will always be a need for fundamental re- 
search and the development of more adequate theories of education, 
it is action research,that will involve the classroom teacher, provid- 
ing an avenue for professional growth and the improvement of the 
curriculum. : 
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ONE OF THE MOST DIFFICULT PHASES OF THE GRADU- 
ate research project is the choice of a suitable problem. The be- 
ginner is likely to select a problem that is much ‘too broad in scope. 
This may be due to his lack of understanding of the nature of re- 
search and systematic problem-solving activity. It may also be 
due to his enthusiastic, but naive, desire to solve an important 
problem quickly and immediately. 
Those who are more experienced know that researth is often 
15 
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tedious, painfully slow, and rarely spectacular. They realize that 
the search for truth and the solution of important problems take 
a great deal of time and energy and the intensive application of 
logical thinking. Before considering the ways in which problems 
may be identified, a discussion of a few of the characteristics of 
research and the activities of the researcher would seem appro- 
priate. 

Research makes its contribution to human welfare by countless 
small additions to knowledge. ` The researcher has some of the 
characteristics of the ant, who brings his single grain of sand to the 
anthill. 

Research is more often a team endeavor than an individual 
one. Researchers working in groups attack problems in different 
ways, pooling their knowledge and sharing the results of their 
efforts. Highly publicized discoveries usually result from the cumu- 
lative efforts of many, working as teams, over long periods of 
time. They are rarely the product of a single individual working 
in isolation. 

Great discoveries rarely happen by accident, When they do, 
the researcher is usually well-grounded and possesses the skill, 
known as serendipity, to recognize the significance of these fortu- 
nate occurrences. He is imaginative enough to seize the oppor- 
tunity presented and to carry it through to a fruitful conclusion. 
Pasteur has observed that chance favors the prepared mind. 

The researcher is a specialist, rather than a generalist. He em- 
ploys the principle of the rifle rather than the shotgun, analyzing 
limited aspects of broad problems. Critics have complained that 
much social research consists of learning more and more about less 
and less until the researcher knows everything about nothing. "This 
is a clever statement, but an exaggeration. The opposite danger 
characterizes much ineffective problem-solving; learning less and 
less about more and more until one knows nothing about every- 
thing. í 

The solution of educational problems is much more likely to 
result when, through research, individuals are willing to pool the 
results of tneir discoveries about limited aspects of problems. If 
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there is a danger in too narrowly subdividing problems, it may 
result when the researcher loses sight of the problem and becomes 
engrossed in merely counting and tabulating data. 

Research is more than compiling data. It is based upon the 
application of rigorous logic to problems, starting with certain 
hunches or assumptions that give direction to data-gathering. 
Then, by the process of testing the hypothesis, generalizations 
are established. The concept of testing implies an objectivity that 
lets the data lead where they will Failure to substantiate the 
hypothesis in the testing process leads the researcher back to a 
modified hypothesis, which then becomes eligible for further test- 
ing and possible acceptance. 


o 


o THE ACADEMIC RESEARCH PROJECT 


A student’s first research project is usually a college requirement, 
in partial fulfillment of the requirements of a graduate course, or 
for an advanced degree. The initial motivation may not be the 
desire to engage in research, but thè practical need of meeting a 
requirement. Projects of this sort are justified on the grounds 

‘that once the student develops some competency in research pro- 
cedures, he will use his “know-how” to seek solutions to educational 
problems, and thus make his contribution to the body of knowledge 
upon which professional practice is based. 

Too often this expectation is not realized, for relatively few stu- 
dents who have had this research experience carry on further 
studies. This failure of classroom teachers to employ research pro- 
cedures may be explained by heavy teaching loads, the lack of 
importance attached to research by school officials, the ineffective- 
ness of university programs in developing competent researchers, 
and the personal inertia of the teachers themselves. 

During the past few years the increased emphasis upon action 
research has added impetus to research activity by classroom teach- 
ers. Confronting practical problems in their day-to-day tasks, they 
have found a practical challenge to apply the methods pf research 
that they have learned. 
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Unfortunately, few research studies accomplished in fulfillment 
of academic requirements make a significant contribution to the 
development of new theories or to the improvement of educational 
practices. The limitations of time and financial resources, the lack 
of experience of the researcher, and the academic hazard of depart- 
ing from relatively safe research projects all serve as limitations to 
significant contributions to the field. 

Perhaps more significant masters degree or doctoral studies can 
be carried on under the direction of an advisor or major professor 
who is devoting his own interest to research in a major educational 
problem area. The studies of degree candidates thus may be 
directed towards certain restricted phases of the major problem, 
making possible long-term longitudinal studies. Sach projects as 
those of A. S. Barr at the University of Wisconsin, on the measure- 
ment and prediction of teaching efficiency, and the studies of L. M. 
Terman at Stanford University on gifted children represent the 
cumulative attack on problems that is likely to yield more sig- 
nificant results than the uncoordinated investigations of candidates 
whose efforts lack this unifying direction and continuity. 

In the light of the varied types and purposes of students' projects, 
the choice of a problem will depend upon the level at which the 
research is done. A problem that would be appropriate for a 
beginner-in a first course in research would be necessarily different 
than that selected for the more rigorous requirements of the. master's 
thesis or the doctoral dissertation. The first topic will necessarily 
be a modest one, which can be carried on by an inexperienced 
researcher in a limited period of time. The emphasis will be placed 
upon the learning process, rather than on its actual contribution to 
education. This statement does not imply that the product is neces- 
sarily unimportant, It merely recognizes that the limitations of 
the first research project place the emphasis on learning how, with 
the hope that subsequent investigations will progressively yield 
more significant contributions to the advancement of knowledge. 

Some students choose a first problem that can be expanded later 
in a more mature treatment at the level of the masters thesis or 


the doctoral dissertation. The first study thus serves as an explora- 
tory process. 
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THE SOURCES OF PROBLEMS 
ə 


The choice of a suitable problem is always difficult. Problem 
awareness is not ordinarily a characteristic of the beginner, and 
even the more experienced researcher approaches this step with 
hesitancy. It is a serious responsibility to commit oneself to a 
problem that will inevitably require much time and energy, and 
upon which so much academic significance is based. 

What are the most likely sources to which one may go for a 
suitable research problem, or from which one may develop a sense 
of problem awareness? 

l. The classroom, school, or community is a logical source. 
Every teacher is confronted with day-to-day problems. Why do 
we do the things we do? Why do we teach the things we teach? 
Do we present ideas and concepts at the appropriate time and in 
the most effective sequence? How can we perform the daily 
teaching tasks more effectively? What is known about learning 
and teaching is inadequate in relation to what there is to know 
Many of our prevailing educational practices are based upon little 
or no substantial researclv evidence. 

Many of the problems observed in the classroom, the school, 
or the community lend themselves to careful investigation. Per- 
haps they are of greater importance than those more remote from 
the teacher's experience. Teachers will discover acres of diamonds 
in their own backyards, and the possessor of the inquisitive and 
imaginative mind may translate one of these problems into a worth- 
while and practicable research project. 

2. Technological changes and social developments are constantly 
bringing forth new problems and new opportunities for research. 
A challenge to education has been introduced by the development 
of commercial and educational television, a field in which much 
research is needed. Decisions as to whether or not television will 
significantly alter the role of the classroom teacher must be based 
upon the contributions of careful research. 

The fears and insecurities created by the Soviet Union's scien- 
tific education policies have raised a demand for drastic changes 
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in the American secondary school But the proposed solutions 
could possibly turn back the clock of educational experience unless 
they are solidly grounded in the evidence established by research. 

3. The graduate academic experience should stimulate the ques- 
tioning attitude towards prevailing practices and effectively pro- 
mote problem awareness. Classroom lectures, class discussions, 
seminar reports, and out-of-class exchanges of ideas with fellow stu- 
dents and professors will suggest many stimulating problems to be 
solved. Students who are fortunate enough to have graduate as- 
sistantships have an especially advantageous opportunity to profit 
from the stimulation of close professional relationships with faculty 
members and fellow assistants. 

Reading assignments in textbooks, special assignments, reports, 
and term papers will suggest additional areas of needed research. 
Such specialized sources as the Encyclopedia of Educational 
Research, Psychological Abstracts, the Review of Educational Re- 
search, the Journal of Experimental Education, the Journal of Edu- 
cational Research, master's theses in education, Dissertation Ab- 
stracts, and many similar publications, are rich sources for problem 
seekers.! 

4. Consultation with the course instructor, advisor, or major 
professor is helpful Several writers have ridiculed the student 
who expects the advisor to assign a problem. Although research 
problems are not assigned, consultation with the more experienced 
faculty member is a desirable practice. 

Most students feel insecure as they approach the choice of a re- 
search problem. They wonder if the problem they may have in 
mind is significant enough, feasible, and reasonably free of unknown 
hazards. To expect the beginner to arrive at the advisor’s office 
with a completely acceptable problem is quite unrealistic. One 
of the most important functions of the research advisor is to help 
the student clarify his thinking, achieve a sense of focus, and de- 
velop a manageable problem from one that may be vague and too 
complex. 


1 These sources are described in Chapter 3, “The Use of Reference Ma- 
terials.” 
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Evaluating the problem 


o 

Before the proposed research problem can be considered appro- 
priate, several searching questions should be raised. Only when 
those questions are answered in the affirmative can the problem 
be considered a good one. 

l. Is this the type of problem that can be effectively solved 
through the process of research? Do the data exist upon which a 
solution may be based? 

2. Is the problem significant? Is an important principle in- 
volved? Would the solution make any difference as far as educa- 
tional theory and practice are concerned? If not, there are un- 
doubtedly more significant problems waiting to be investigated. p 

3. Is the problem a new one? Is the answer already available??? 
Ignorance of prior studies may lead a student to needlessly spend Z, 
time on a problem already investigated by some other worker. : 

While novelty or originality is an important consideration, thee) : 
fact that a problem has been investigated in the past does not mean o + 
that it is no longer worthy of study. There is constant need for Lx 
verification of the findings of previous investigations, using newer) 3\ 
and better devices and procedures. There is also a need for the? s 
testing of former findings under changed cultural conditions. : | 

4. Is the problem feasible? After a research project has been 
evaluated, there remains the problem of suitability for a particular 
researcher. While the problem may be a good one, is it a good 
problem for me? Will I be able to carry it through to a successful 
conclusion? Some of the questions that should be raised are: 

a) Do I have the necessary competence to plan and carry out 
a study of this type? Do I know enough about this field to under- 
stand its significant aspects and to interpret my findings? Am I 
skillful enough to develop, administer, and interpret the necessary 
data-gathering devices and procedures? Am Pwell-grounded in the 
necessary knowledge of statistical techniques? 

b) Are pertinent data accessible? Are valid and reliable data- 
gathering devices and procedures available? Will school authori- 
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ties permit me to contact the students, conduct necessary experiments 
or administer necessary tests, interview teachers, or have access to 
important cumulative records? Will I be able to” get the sponsor- 
ship necessary to open doors that otherwise would be closed to 
me? 

c) Will I have the necessary financial resources to carry on this 
study? What will be the expense involved in data-gathering equip- 
ment, printing, test materials, travel, and clerical help? If the 
project is an expensive one, what is the possibility of getting a 
grant from a philanthropic foundation or agency? 

d) Will I have enough time to complete the project? Will there 
be time to devise the procedures, select the data-gathering devices, 
gather and analyze the data, and complete the résearch report? 
Since most academic programs impose time limitations, certain 
worthwhile projects of a longitudinal type are precluded. 

e) Will I have the courage and determination to pursue the 
study in spite of the difficulties and social hazards that may be 
involved? Will I be willing to work aggressively when data are 
difficult to gather and when others are reluctant to cooperate? 

Will I be willing to risk the criticism, suspicion, or even oppo- 
sition that a delicate or controversial study may raise? Sex edu- 
cation, racial integration, communism, and other controversial prob- 
lems are almost certain to stir up emotional reactions in certain 
quarters. | 


THE AGENDUM OR RESEARCH PROPOSAL 


The preparation of an agendum, or research proposal, is an im- 
portant step in the research process. Many institutions require that 
a proposal be submitted before any project is approved. This pro- 
vides a basis for the evaluation of the project, and gives the advisor 
a basis for assisting during the period of his direction. It also pro- 
vides a systematic plar of procedure for the researcher to follow. 

The agendum is comparable to the blueprint which the architect 
prepares before the bids are let and building commences. The 
initial draft of the agendum is subject to modification in the light 
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of the analysis by the student and his project advisor. Since good 
research must be carefully planned and systematically carried out, 
procedures that àre improvised from step to step will not suffice. 
Only with a well-designed agendum will a worthwhile research 
project be likely to result. 

The list which follows presents the essential parts of a research 
proposal, with a brief explanation of each step. ( 

1. The statement of the problem, either in question form or as a 
declarative statement. This attempt to focus on a clear goal gives 
direction to the research process. It must be limited enough in 
scope to make a definite conclusion possible. The major statement 
or question may be followed by minor statements or questions. 

It may be appropriate here to formulate a major hypothesis and 
several minor hypotheses. A good hypothesis has several basic 
characteristics: 


1. It should be reasonable. 

2. It should be consistent with known facts. 

3. It should be stated in such a way that it can be tested as true 
or false. 

4. It should be statedein as simple terms as possible. 


Following these statements of hypothesis, possible conclusions may 
be suggested. This approach clearly establishes the nature of the 
problem and the logic underlying the investigation, and gives direc- 
tion to the data-gathering process. 

2. The significance of the problem. Yt is important that the 
researcher point out how the answer to the question or the solu- 
tion to the problem can influence educational theory or, practice. 
Careful formulation and presentation of the implications or possible 
applications of knowledge helps to give thesproject an urgency, 
justifying its worthwhileness. 

Failure to include this step in the proposal may well leave the 
researcher with a problem without significance—a search for data 
of little ultimate usefulness. Many of the tabulating types of re- 
search problems should be abandoned if they do not withstand the 
critical test of significance. Perhaps university library sbelves 
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would not groan with the weight of so many unread and forgotten 
dissertations if this process had been rigorously applied. With so 
many gaps in educational theory, and so many areas of educational 
practice in need of improvement, there is little justification for the 
expenditure of research effort on trivial or superficial investiga 
tions. 

3. Definitions, assumptions, and limitations. It is important to 
define all unusual terms that could be misinterpreted. This defi- 
nition helps to establish the frame of reference with which the 
researcher approaches the problem. The assumptions that the 
researcher makes, and the restrictions and limitations that he recog- 
nizes, must be frankly stated. This recognition helps to focus atten- 
tion on valid objectives, and helps to minimize the dangers of over- 
generalization. 

4. A résumé of related literature. This brief summary of previ- 
ous research and the writings of recognized experts provides evi- 
dence that the researcher is familiar with what is alre 
and what is still unknown and unproven. 
must be based upon past knowled 
clude the duplication of what is kn 
tions for future investigation. 


ady known, 
Since effective research 
ge, this step would help to pre- 
own, and provide helpful sugges- 


5. A careful and detailed analysis of proposed research pro- 
cedures. This part of the proposal identifies the entire research 
plan. It describes just what must be done, how it will be done, 
what data will be needed, what data-gathering devices will be em- 
ployed and an evaluation of their validity and reliability, how 
sources of data will be selected, and how the dat 
and conclusions reached. 

6. A time schedule. A schedule should be prepared so that the 
researcher may budget his time and energy effectively. Dividing 

"the project into parts and assigning dates for the completion of each 
part helps to systematize the project and minimize the natural 
tendency to procrastinate, 

Some phases of the problem cannot be started until other phases 
have been ‘completed. Some parts of the final research report, 
such as the review of related literature, can be completed and 


a will be analyzed 
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typed while waiting for the data to be gathered. Since academic 
research projects, usually involve rather critical time limitations 
and definite deadlines for filing the completed report, this pre- 
planning of procedures with definite date goals is most impor- 
tant. 


THE PROGRESS REPORT 


From time to time the major professor or advisor may request 
a progress report indicating how well the project is progressing. 
This device also serves as a stimulus, helping the researcher to 
move systematically towards the goal of completing the project. 


o 


THE FIRST RESEARCH PROJECT 


Experience has indicated that one of the best ways to under- 
stand the methodology and processes of research is to actually 
engage in research. Such a project ‘may be very modest in nature 
and necessarily limited by time, the experience of the student, and 
many other factors associated with the graduate student's home and 
teaching obligations. However, the methodology may be learned 
by this doing and thinking, under the careful supervision of the 
instructor of the beginning course in research. Respectable re- 
search projects have been carried on and reported within a semes- 
ter's time, even within an eight-week summer session. While most 
of these studies have been of the descriptive-survey type, some 
simple historical and experimental studies have been completed. 

The emphasis must necessarily be on the process rather than 
on the product or its contribution to the improvement of educational 
practice. A study chosen for this first project may not be of great 
enough significance to serve as an appropriate thesis problem. 

The activity may be an individual or a group enterprise. Groups 
of three to five graduate students can profitably work together on 
the planning of the study. Data-gathering devices may be chosen 
or constructed through joint enterprise. Data may be gathered 
within the university graduate class, or in the classrooms, schools, 
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or communities in which the groups members teach. However, it 
is recommended that the next steps—organization and analysis of 
data and the writing the final report-be an individual project. 
There is always the danger in a group project of "letting George 
do it," and incidentally letting George get all of the values of the 
experience. 

This recommended combination of group effort in the initial 
stages and individual effort in the later stages represents a com- 
promise that seems effective, and enables students to carry through 
a study in a limited amount of time with reasonable opportunity 
for personal growth in the process. For some of those who plan 
to write a thesis in partial fulfillment of degree requirements, this 
first project may serve as preparation. For others, it may initiate 
a study capable of subsequent expansion into a thesis or disserta- 
tion. 


RESEARCH TOPICS USED BY STUDENTS IN A BEGINNING 
GRADUATE COURSE IN EDUCATIONAL RESEARCH 


Entrance Requirements of Indiana Colleges 
Reading Habits of a Group of Teachers 
Community Attitudes toward Extra-Class Activities 
Television Viewing Habits of Fifth Grade Students 
. An Analysis of Errors of Beginning Typists 
. Attitudes of Teachers toward Racial Integration in the Secondary 
School 
7. A Comparison of the Academic Achievement of Athletes and Non- 
athletes at Kokomo High School 
8. Factors Associated with Delinquency in a Group of Boys at the 
Indiana Boys School 
9. An Analysis of Masters’ Degree in Education Programs in a Group 
of Midwest Universities 
10. Attitudes of Teachers towards Federal Aid to Education 
11. A Follow-Up Study of Nonpromoted Students at School #86. 
12. The Status of Latii. in Indiana High Schools 
13. Attitudes of High School Seniors towards Proposed Compulsory Mili- 
tary Training 
14. Fund-Raising Activities at Columbus High School 
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. Criteria Used in Determining School Marks 

. An Analysis of Problems of High School Freshmen as Indicated by 
the Mooney Problems Check List 

- A Follow-Up Study of the 1950 Graduates of Hanover College 

. Absenteeism among Freshmen at Southport High School 

. The Use of Audio-Visual Aids in Hamilton County High Schools 

. Library Facilities in Warren Township Schools 

- Class Size in Wayne Township Elementary Schools 

. Parents’ Attitude towards School Discipline 

. Why Freshmen Chose Butler University 

. Allowances and Earnings of Pike Township High School Seniors 

. What Pupils Like and Dislike in Teachers 

. Discipline Problems at Washington High School as Viewed by the 
Teachers e 

- Discipline Problems at Washington High School as Viewed by the 
Seniors 


28. The Predictive Value of SCAT Test Scores at Butler University. 
29. Why Teachers Leave Teaching 
30. A Comparison of Vocabulary Levels in Three Textbook Series in 


Reading 
. Factors Underlying the Choice of Teaching as a Profession 


32. The Predictive Value of Entrance Examinations at the Methodist 


Hospital School of Nursing 
. Teacher Expenditures for Professional Improvement 
. Teacher Attitude toward the Year-Round School Program 
. Outside Nonteaching Employment of Teachers 


36. Truancy in Boone County High Schools 
87. A Comparison between Two Methods of Teaching Typing 


. The Instrumental Music Budgets of a Group of Central Indiana High 


Schools i E : 
. Expenses Involved in Extra-Class Participation at Madison High 


School 


40. The Treatment of Educational Topics in the Indianapolis Times 


. The Influence of Color Combinations in the Teaching of Spelling 

. Student Publications in Miami County High Schools 

. The Treatment of Communism in Social Problems Textbooks à 

. Social. Studies Teacher Certification Requirements in Ten Mid- 


western States . é y 
. The Influence of Background Music on Learning to Spell in the Sixth 


Grade 4 
. The Summer Employment of High School Juniors 
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47. Career Guidance Programs in Indianapolis High Schools 

48. The Predictive Value of Reading Readiness Test Scores at Orchard 
School 

49. The Newspaper Reading Habits of a Group óf Teachers 

50. An Analysis of the Cafeteria Eating Habits of Shortridge High School 
Sophomores 


SUMMARY 


Beginning research students tend to choose problems too broad 
in scope. They do not always understand the highly specialized 
nature of research activity. Because the first project is usually the 


result of a requirement to be met, their motivation is not always a 
genuine desire to carry on research. 


Few academic research Projects make a significant contribu- 
tion to educational theory or practice. Too few academic research- 
ers continue to engage in research activity after they leave the uni- 
versity. The recent emphasis on action research, however, has had 
an encouraging effect on research by classroom teachers. 

Problems are found in the teacher? daily classroom, school, and 
community experiences, Technological and social changes call for 
research evidence to chart new courses in educational practice, 
Graduate academic experience helps to promote problem aware- 
ness through activities of the classroom, reading, and interaction 
with fellow students, instructors, and advisors. 

A good research problem has the qualities of significance, orig- 
inality, and feasibility. The researcher should evaluate a proposed 
problem in the light of his competence, the availability of data, the 
financial demands of the project, the limitations of time, and the 
possible difficulties and social hazards involved. 

An agendum, or research proposal, is required by many insti- 
tutions, and serves as a useful basis for the evaluation of a 
project as well as a guide for the researcher. The agendum con- 
tains a clear and concise statement of the problem, the hypothesis 
or hypotheses involved, a recognition of the significance of the 
problem, definitions of important terms, assumptions and limita- 
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tions, a résumé of related literature, an analysis of proposed re- 
search procedures, and a time schedule. Some advisors request a 
progress report from,time to time in order to evaluate the progress 
of the investigation. 

An effective way to learn about research is to carry on a modest 
research project. This group or individual activity may be carried 
on in connection with the beginning course in educational research, 
with emphasis on the process rather than upon the contribution of 
the study to educational practice. ^ 
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PRACTICALLY ALL HUMAN KNOWLEDGE CAN BE FOUND 
in books and libraries. Unlike other animals that must start anew 
with each generation, man builds upon the accumulated and re- 
corded knowledge of the past. His constant adding to the vast 
store of knowledge makes possible progress in all areas of human 
endeavor. 

Undergraduate students sometimes receive special iristruction 
in the use of the library and its facilities, but too often their library 

31 
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activities are confined to assigned and suggested readings. Gradu- 
ate students must find their own references. Few graduate stu- 
dents, however, and not all faculty members, have an adequate 
familiarity with the library and its many resources for the effective 
search for specialized knowledge. 

Extensive use of the library and thorough investigation of related 
literature is essential in preparing graduate term papers, seminar 
reports, and in planning and carrying out the kind of searching 
involved in special field problems, theses, and dissertations. 

The search for reference material is a time-consuming but fruit- 
ful phase of the graduate program. A familiarity with the literature 
in any problem area helps the student to discover what is already 
known, what others have attempted to find out, what methods of 
attack have been promising or disappointing, and what problems 
remain to be solved. Knowing how to use the library effectively 
should receive primary emphasis in the graduate program in educa- 
tion. To know what sources to use, what sources are available, 


and where and how to find them will save many hours of aimless 
activity. à 


LEARNING TO USE THE LIBRARY 


The graduate student should become thoroughly acquainted with 
the university library, the location of its varied facilities, and the 
regulations governing the use and circulation of materials. Many 
university libraries have a printed guide that contains helpful infor- 
mation. A diagram may indicate the location of the stacks, the 
periodicals room, the reference division, reading rooms, and special 
collections of books, microfilm or microcard equipment, clippings, 
manuscripts, or pamphlets. Another useful part of the guide may 
list the periodicals to which the library subscribes and the names 
of special indexes, abstracts, and other references available, A 
third section may d2al with the regulations concerning the use of 
the stacks, the use of reserve books, and the procedures for secur- 


ing materials held by the library or those that may be procured from 
another library. 


A 


à 
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It is well to use the skill and knowledge of librarians, who are 
anxious to help the student find reference materials. The gradu- 
ate student should not depend too much on the librarian, however, 
but should learn to find his own references. 

Ordinarily, undergraduates fill out call slips for presentation at 
the circulation desk, when they wish to use a book. Faculty mem- 
bers and graduate students are usually given a card giving them 
access to the stacks, and thus may carry on the independent search- 
ing and browsing not possible when each book must be requested 
by name. 

Most libraries prefer that students not replace books on the 
shelves after they have been used, for a misplaced book creates 
confusion both for librarians and other students seeking it. If stu- 
dents leave the books with which they are finished on the tables, 
the librarians will return them to their proper position on the 
shelves. 

Sometimes a student learns of a reference that is not available 
in the local library. Many libraries subscribe to a "union" cata- 
logue, which lists references found in other libraries. Most libraries 
have a union list of serials to indicate the libraries where particular 
serial publications may be óbtained. There are a number of ways 
in which these materials may be obtained by a library: 

l. By interlibrary loan. The library may request that the work 
be sent and then checked out to the user. Note that the library 
must request this material. It is never sent directly to the user. 

2. By requesting a photostatic copy of a page or of a number of 
pages of a desired reference. 

3. By requesting a microfilm. For an established fee a microfilm 
may be purchased. This may be projected on library microfilm 
equipment. ° 

4. By an abstracting or translating service. Some large libraries 
Provide copied or translated portions of needed materials at an 
established fee. P 

In connection with any of the above services, the user is expected 
to bear the costs involved in reproducing, handling, and shipping 


the materials. 
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* THE CARD CATALOGUE 


The card catalogue, an alphabetical listing, may be compared to 
the index of a book. It is the index to the entire library, listing 
the contents of all publications found in the library, with the excep- 
tion of serially published periodicals. These compact 3"x5" card 
forms provide a quick and convenient way to find all of the books, 
monographs, or pamphlets found on the library shelves. 

The cabinet drawers of the card catalogue are alphabetically 
labeled, and also numbered sequentially, to facilitate replacing them 
in the proper place when they have been removed. Printed cards 
are prepared by the H. W. Wilson Company or By the Library of 
Congress. College and university libraries usually use these pre- 
pared cards. Smaller libraries often prepare their own. 


library call 
number author title 


e 


Cavanah, Frances, ed. 


found in 
reference 


Family reading festival; stories & poems to read togeth 
room 5 3 ees 
Illustrated by Maurice Brévannes. ‘Englewood Cliffs, N. J. 
Prentice-Hall ,1958, osmem. gegen 
" 326 im EJ Sao 
publisher PS HEN SES 
pages other 
size (ht) listings 
1, Literature— Collections. 2. American literature (Selectiona: 
Extracts, etc.) 38, English literature (Selections: Extracts, etc.) 
LC. call 1. Title. L.C. card 
Monter PN6014.C335 808.8 58-0314 t number 
Library of Congress 2, D.D, call 
number 


Fig. 3-1 Library of Congress author card. 


When printed cards are used, they contain a great deal of useful 
information. The card illustrated in Fig. 3-1 is a typical Library 


? In this chapter, all references regarded by the author as basic to research 
in education will be marked, as here, with an asterisk, 


aac 
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of Congress card. The call number" in the upper left corner is 
written in by the librarian. For the sake of convenience in finding 
books, the card catalogue has two and often three listings for each 
book. A few libraries have a fourth card for some books. 


1. author card 

2. subject card 

8. title card 

4. analytical card 

The author card is filed, last name first (Alexander, Carter). 
One can find any or all publications credited to the author. In the 
case of joint authorship a card is filed separately for each author. 
Societies, associations, editors of yearbooks, committees, and govern- 
ment departments are listed as authors when no author is credited 
with the publication. 

The subject card is filed under the appropriate heading. Since 
headings run from general to specific, counseling, a subtopic, would 
follow guidance. When a book is about an author, his name is 
considered a subject. Books about John Dewey are listed under 
the subject, Dewey’ John. 

» The title card is filed under the actual name of the book. Initial 
articles, a, an, or the are disregarded. Thus, The Elements of Re- 
search is filed under Elements of Research. 

The analytical card, used by some large libraries, provides a ref- 
erence to important sections of a book that deal with an important 
Subject or person. For example, De Kruifs Microbe Hunters has 
a section on Ehrlich which can be called to the attention of the 
reader by the special analytical card. This title, filed separately, 
indicates that the volume has a section on the person or topic cited. 

Ordinarily, the card catalogue covers only the books in that 
specific library. In very large university libraries there may be 
found the union catalogue, which contains duplicates of the card 
catalogue of the Library of Congress, or duplicates of cards found 
in other important libraries in the United ue Instead of a 
union catalogue, some libraries have a photoprinted, bound-book 
copy of the Library of Congress catalogue, eighteen cards to a 


Page. 
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LIBRARY CLASSIFICATION 


Library systems of book classification are complex but ingenious 
ways of systematizing the placement and location of books. There 
is a tremendous amount of detail involved in these systems, but 
they have been devised in a logical and neat way. Library classifi- 
cation is a science based upon a methodology that is logical and 
orderly to the smallest detail. While it is beyond the scope of 
this chapter to explain all of the details of book classification, a 
few principles and procedures are presented that should prove 
helpful to the library user. 


The call number $ 


Most libraries use the Dewey Decimal system of classification, 
as published by Melvil Dewey (1851-1931) in 1876 and adopted 
by the Amherst College Library in 1873. The system, or some 
modification of it, is now used in 89% of the. college and univer- 
sity libraries, 96% of public libraries, and in 64% of all special libraries 
in the United States. It is also widely üsed in libraries in England 
and in other parts of the world. 


000 General references, periodicals, cyclopedias, biography 
100 Philosophy, psychology 

200 Religion 

300 Social Sciences 


310 Statistics 

320 Political Science 

330 Economics 

340 Law 

350 Administration 

360 Welfare Assns. and Institutions 
370 Education (General) 

370.1 Theory and Philosophy of Education 
370.9 History of Education 

371 Teachers—Methods 

372 Elementary Education 

873 Secondary Education 

374 Adult Education 


h 
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375 Curriculum 

376 Education of Women 

377 Religious, ethical education 

378 Hither Education 

879 Public Schools (Relation of State to Education) 
379.14 School Law 

379.15 Supervision and Control 


380 Commerce, Communications 
390 Customs 

400 Linguistics 

500 Pure Science 

600 Applied Science 

700 Arts and Recreation 

800 Literature 

900 History 


It will be noted that the Dewey Decimal system is, as its title in- 
dicates, a decimal plan, the numbers running from 001 to 999.99. 
Following is a typical breakdown: 

001 -300 
800 -370 
870 -37% 


. 379.1 —379.9 
379.91-379.99 


o 


Library of Congress system 


Some of the more extensive libraries, particularly in large univer- 
sities, use the Library of Congress system of book classification, 
published in 1902. This system, devised by Dr. Herbert Putnam 
and authorized by an act of Congress in 1880, is especially useful 
in large libraries consisting of individual collections, housed sep- 
arately. It provides for twenty main classes instead of the ten 
of the Dewey Decimal system. Letters of the. alphabet are used 


for the principal headings, but numerals are used for further sub- 
grouping in a fashion somewhat similar to the Dewey Decimal 


System. ( 
The tremendous size of the national Library of Congress at Wash- 


ington is evidenced by its growth from two million volumes in 1899 
to over twenty-nine million volumes in 1950. 


^ 
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Below is a listing of the main classifications in the Library of 
Congress System: 


General Works e 
Philosophy, Religion 
History 
World History 
American History 
Geography, Anthropology 
Social Sciences 
vacant 
Political Science 
Law 
Education 
LA History of Education 
LB Theory of Education E 
LC Special forms and applications 
LD U. S. Schools 
LE American Education (Outside U. S.) 
LF European Education 
LG Asia, Africa, Oceana 
LH School Periodicals 
LI vacant 
LJ  Fraternities, Societies Á 
LT Textbooks | 
Music i 
Fine Arts | 
vacant 
Language, Literature 
Science 
Medicine 
Agriculture 
Technology 
Military Science 
Naval Science 
vacant 
vacant 
vacant 


Library Science— Bibliography 


yy 


ER—UmoHgOU» 


NAxZ4dHduemHo"vozz 


Book placement . 

All books have a call number or letter that appears in the 
upper left-hand corner of the author, subject, or title card, and 
on the spine of the book itself, Books are placed on the library 
shelves serially by call numbers or letters. Within each classifica- 


' mentioned. The usefulness of similar sources is co 


samon 
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tion the books are arranged alphabetically by author's last name. 
An exception to this rule is that biographies are placed under the 
subject, rather thai, the author, of the book. 

Most libraries use an additional classification device known as 
the Cutter-Sanborn System. This system adds author numbers 
to the basic classification to represent the first letter of the author's 
name, and additional numbers to distinguish between authors whose 
names begin with the same initial. 

Other systems such as the Bliss, Quinn Brown, Universal Decimal, 
and Colon systems are described in the specialized literature of 
book classification in library science. 


o 


GENERAL REFERENCES 


There are several basic reference books, with which all graduates 
should be familiar, that list many types of references and cover prac- 
tically all areas of human knowledge. 


Constance M. Winchell, ed.” A Guide fo Reference Books, 7th ed. 
Chicago: American Library Association, 1951. 645 pp. Ist sup- 
plement, 1954. 117 pp. 2nd supplement, 1956. 134 pp. 

This comprehensive work, edited by Isadore A. Mudge from 
1936 to 1950, lists by subject area, by type of reference, and by 
author or editor the most important reference books printed not 
only in English but in other languages. A section is devoted to 


education. 


Louis Shores, ed., Basic Reference Sources. Chicago: American 
Library Association, 1954. 378 pp. 

sive review of all types of refererices. An especially 
n and evaluation of the sources 
mpared. 


A comprehen: 
valuable feature is the descriptio 


Mary N. Barton, ed., Reference Books, 2nd ed. Baltimore: Enoch 


Pratt Free Library, 1951. 99 pp. 
This shorter guide lists reference books in 
cludes helpful descriptive comments on their use. 


many areas and in- 
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* Carter Alexander and Arvid J. Burke, How fo Locafe Educational 
Data and Information, 4th ed. New York: Bureau of Publications, 
Teachers College, Columbia University, 1958. 436 pp. 

This specialized volume lists many reference sources in education 
and describes the contents of each source and how it should be 
used. It also has valuable suggestions on the use of the library, 
and is probably the most important single reference on references 
for graduate students in education. 


PERIODICALS 


Up-to-date treatment of educational problems, contemporary 
opinions, and the latest reviews and reports of educational research 
will be found in periodicals or serials; A periodical or serial is 
defined as “a publication issued in successive parts, usually at regu- 
lar intervals, and, as a rule, intended to be continued indefinitely." 1 
Included in this definition are almanacs, yearbooks, directories, 
handbooks, government documents, publications of societies and 
associations, and newspapers and magazines. 

Without comprehensive guides the searching of thousands of: 
periodicals would be a nearly impossible task. Fortunately, a num- 


ber of useful indexes and abstracts are available to the student in 
education. 


THE INDEX 


A periodical index serves much the same purpose as the index of a 
book or the card file of the library. Usually listing articles alpha- 
betically under subject, title, and author headings, it identifies the 
source of the articies cited. Readers should read the directions 
of any index carefully before trying to find references. Most in- 
dexes provide complete directions, as well as a list of the periodi- 
cals covered, the dates of issues included, the proper volume, and 
a key to all abbreviations used. 


lLouis Shores, ed., Basic Reference Sources (Chicago: Ameri i 
Association, 1954), p. 160. f E Se Seay 


Ay 
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* Education Index. New York: H. W. Wilson Co., 1929-date. Pub- 
lished in three editions: paperbound, monthly (September through 
June); clothbound,, annually (cumulative, June); and clothbound, every 
three years (issues Uated 1953-56, etc.]. 


Of a number of indexes and abstracts that will be described, the 
Education Index is the most valuable single source or guide to 
periodic literature in education. Since its first publication in 
January, 1929, it has served as a comprehensive index of practically 
all publications in the area of education. 

The Education Index lists: 


1. All books on professional education including college textbooks 
in education. 4, 

2. Yearbooks and other publications of professional societies, asso- 
ciations, and institutions. 

3. Bulletins, monographs, and reports on education. 

4. Publications of the United States Office of Education. 

5. Publications of the National Education Association and its many 


: member organizations. 


6. Articles in most educational periodicals (over 175 periodicals are 
indexed). > 

7. Articles on edtication in ribnprofessional publications. 

8. Bibliographies published. 

9. Book reviews and book lists. 

10. Biographies of educators. 

11. Courses of study published. 

12. Resource and teaching units. 

18. Tests, scales, inventories, workbooks, handbooks, and manuals. 

14. Reference books. 

15. Poems. 

16. Portraits (por.) and illustrations (illus.). 

17. Names of foundations and associations. $ 

18. Meeting dates of professional education associations. 


The references appear in the paperbound monthly edition two 
or three months after the articles appear in the périodicals. College 
and university libraries, most large public libraries, and many small 
libraries subscribe to the Index. The price of the service is based 
upon the number of listed periodicals to which the library sub- 


scribes, making it less expensive for smaller libraries, which do 


not take as many periodicals. 


In using the Index it is often advisable to use past cumulative 
LI 
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issues, for references are not carried from one three-year book to 
the next. It is often helpful to know when a particular topic or 
problem «was of current interest for Index issues from that period 
will yield more and better references. 

For example, in 1954 the author found few references on articles 
dealing with cheating or dishonesty in the classroom. However, 
many references were found in the 1952 issue and the 1950-53 
cumulative issue, for at this time the public interest and professional 
concern had been aroused by the exposures of cribbing at the 
United States Military Academy in 1951. 


* Readers’ Guide to Periodic Literature. New York: H. W. Wilson 

Co., 1900-date. 

»This guide indexes articles of a popular and general nature. 
Prior to 1929, when the Education Index was established, Readers’ 
Guide covered many of the educational journals. By 1929, the 
volume of educational periodicals and literature had become so 
great that the Education Index was established as a more special- 
ized guide. ° » 

Readers’ Guide is helpful to students in education in finding ref- 
erences to articles in areas outside the field of professional education. 


Abridged Readers' Guide to Periodic Literature. New York: H. W. 

Wilson Co., 1935-date. 

Indexes the thirty-five selected periodicals most often found in 
smaller libraries. 


* International Index to Periodic Literature. New York: H. W. Wilson 

Co., 1913-date. 

Indexes alphabetically, by author and subject, articles from over 
175 periodicals in the social sciences and the humanities, including 
many published outside the United States. Issued quarterly, cumu- 
lated annually and every three years. R 


Subject Guide to Books in Print. New York: R. R. Bowker Co., 1957. 

1425 pp. . 

A comprehensive list of 91,000 in-print titles, of 861 publishers, 
under 22,000 subject headings, and with 28,000 cross-references. 
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National Education Association. Publications List. Washington: 

the Association. 

Published annually, this list includes all books, pamphlets, peri- 
odicals, audio-visual material, research reports, and proceedings of 
the association. Over one thousand publications are listed in the 
1957-58 edition. 


* Cumulative Book Index. New York: H. W. Wilson Co., 1928-date. 


This monthly publication indexes all books published in the Eng- 
lish language by author, title, and subject. It is helpful in assur- 
ing the student that all pertinent published books have been cov- 
ered in his researches. It is cumulated twice yearly, in July and 
December, and also bound into one or two year cumulations. 


Bibliographic Index. New York: H. W. Wilson Co., 1938-date. 


Published quarterly, and cumulated annually and every six years. 
A bibliography of bibliographies covering over 1,500 periodicals 
and books in all areas. - 


Public Affairs Information Service Bulletin. New York: Public Affairs ' 

Information Service, 1915-date, 

Published weekly, and cumulated quarterly and annually. 
Lists, by subject, all articles in books, pamphlets, government pub- 
lications, periodicals, and society publications dealing with social, 


political, and economic affairs in the English language throughout 
the world. 


* Elementary School Journal. Chicago: The University of Chicago 

Press. Issued ten times each year. 

Each issue includés a bibliography covering some phase of ele- 
mentary education, each phase being covered regularly each year. 


* School Review. Chicago: The University of Chicago Press. Issued 

ten times each year. 

Each issue includes a bibliography covering some area of sec- 
ondary education. The schedule of topics is systematized so that 
particular areas are covered annually. 


— i aa 
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* Dissertation Abstracts. Ann Arbor, Michigan: University Micro- 

films, 1955-date. This publication is the result of a merger between 

Microfilm Abstracts. Ann Arbor: 1952-55; and Doctoral Disserta- 

tions Accepted. by American Universities. New York: H. W. Wilson 

Co., 1933-55. 

Issued monthly and indexed annually, Dissertation Abstracts 
alphabetically lists doctoral dissertations accepted by over 130 col- 
leges and universities in the United States and Canada, classified 
by subject field, institution, and author. This agency microfilms 
dissertations, regardless of length, for a nominal fee. Libraries 
may purchase complete microfilm copies or even individual pages. 


Stanley B. Brown and Mary L. Lyda, eds., Research Studies in Educa- 

fion. Bloomington, Ind.: Phi Delta Kappa, 1953-date. 

A listing of doctoral dissertations and field studies in education 
completed or underway. The 1957 edition lists authors alphabeti- 
cally, and includes an up-to-date bibliography in research meth- 
odolgy by Carter V. Good. 


. T. A. Lamke and H. M. Sc eds., Masters’ Theses in Education. 
Cedar Falls, la.: Research Publications, 1952-date. 


Issued annually, this publication lists most theses written in par- 
tial fulfillment of master's degree requirements in American and 
Canadian colleges and universities. Titles are listed alphabetically 
by area, state, institution, and author. 


Thomas K. Cureton, Masters’ Theses in Health, Physical Education and 

Recreation. Washington: American Association of Health, Physical 

Education and Recreation, 1952. 292 pp- 

An index of 3,878 research studies classified, by topic and by 
methods. 


res, Bibliographies and. Summaries in 


d Louis Sho y 
ENEE EEE New York: H. W. Wilson Co., 1936. 470 


PP- 
ibli hies and summaries 

Cc ore than 4,000 annotated bibliograp mari 
by pani eti subject for the period 1910-35. For later bibliog- 


raphies, one of the more recent indexes should be used. 
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Henry L. Smith and William |. Painter, Bibliography of Literature on 

Education in Countries other than the United States. Bloomington, 

Ind.: Indiana University, School of Education, pr. 341 pp. 

An annotated bibliography of books and periodical material on 
foreign education from 1925-37. 


Specialized indexes . 


A number of more specialized indexes are listed and briefly de- 
scribed. 


Agricultural Index. New York: H. W. Wilson Co., 1916-date. 


Issued monthly and cumulated annually and biennially. Covers 
periodicals, books, pamphlets, and official reports of the various 
state departments and the United States Department of Agricul- 
ture. 


Art Index. New York: H. W. Wilson Co., 1930-date. 


Issued quarterly with cumulation every three years. Covers over 
150 selected magazines and museum publications in English aná 
other languages. It also includes book reviews and exhibition in- 
formation on the fine arts and related areas. 


Business Education Index. New York: Business Education World, 
1940-date. 


Issued annually, it indexes articles by author and subject listing. 


Music Index. Detroit: Information Service, Inc., 1949-date. 


Issued monthly with annual cumulation. Covers over eighty 
periodicals. Indexes material on composers, compositions, reviews, 
obituaries, and performances. 


Industrial Arts Indéx. New York: H. W. Wilson Co., 1913-58. 


Issued monthly and cumulated annually. Covers over 200 peri- 
odicals. indexes articles dealing with all phases of economic ac- 
tivity. Since January, 1958, this index has been replaced by two 
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separate indexes: Applied Science and Technology Index and Busi- 
ness Periodicals Index. 


DN 


Applied Science and Technology Index. New York: H. W. Wilson 

Co., 1958-date. 

Formerly a part of The Industrial Arts Index, this index covers 
almost 200 periodicals in chemistry, physics, electricity, engineer- 
ing, and industrial and mechanical arts. 


Business Periodicals Index. New York: H. W. Wilson Co., 1958-date. 


Formerly included in The Industrial Arts Index, this index covers 
over 100 periodicals in the fields of business, accounting, labor and 
management, marketing and purchasing, office management, public 
administration, banking and finance, taxation, insurance, and a 
variety of specific fields of business enterprise. 


United Nations Document Index. New York: United Nations, 1950- 
date. > 
. Issued monthly. All U. N. publications are listed by subject and 
issuing body. , 


Catholic Periodical Index. New York: Catholic Library Association, 

1939-date. 

Published quarterly with periodic cumulations, it indexes more 
than sixty Catholic periodicals, newspapers, and bulletins. The 
Catholic viewpoint is presented in many fields, including educa- 
tion. 


New York Times Index. New York: 1913-date. > 

Published biweekly with annual cumulation. Classifies material 
in the New York Times alphabetically and chronologically under 
subject, title, person, and organization names. It is also useful in 
locating materials in other newspapers because it gives a clue to 
the date of events. Complete issues of the New York Times are 
available in microfilm form in many libraries. J 
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Occupational Index. New York: Occupational Index, Inc., New York 

University, 1936-date. 

Issued monthly with annual cumulation. IZdexes more than 100 
general and technical periodicals by subject, title, and author. 


Gertrude Forrester, ed., Occupational Literature. New York: H. W. 

Wilson Co., 1958. 467 pp. 

Lists more than 4400 selected references to books and pamphlets 
with annotations. 


Patricia H. Suttles, ed., Elementary Teachers Guide to Free Cur- 


riculum Materials. Randolph, Wisc.: Educators Progress Service, 
1944-date. 


Lists helpful teaching materials, indexed by subject and title 
with descriptive notes. 


Mary F. Horkheimer and John W. Diffor, eds., Educator's Guide to 
Free Films. Randolph, Wisc.: Educators Progress Service, 1941-date. 


Issued annually, the 16th edition lists 3,455 films including 766 


titles not previously listed. Indexed by. subject and title and cros$- 
indexed for convenient reference. 


Mary F. Horkheimer and John W. Diffor, eds., Educator's Guide to 
Free Slidefilms. Randolph, Wisc., Educators Progress Service, 1949- 
date. 


Issued annually, this publication lists slide films, indexed by sub- 
ject and title, and cross indexed. 


Walter A. Wittich and G. H. Halsted, eds., Educators Guide to 

Free Tapes, Scriots and Transcriptions. Randolph, Wisc.: Educators 

Progress Service, 1955-date. 

Published annually and arranged by curricular areas with subject 
and title index; nanies and addresses of sources are indicated. 


Educational Film Guide. New York: H. W. Wilson Co., 1948-date. 


Issued monthly with annual cumulation. New motion picture 
films indexed by subject and title. 
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Filmstrip Guide. New York: H. W. Wilson Co., 1948-date. 


Issued monthly with annual cumulation. Indexes latest releases 
of film strips and fin slides. 


Vertical File Service Catalogue. New York: H. W. Wilson Co., 

1932-date. 

Issued monthly, the catalogue indexes pamphlets and current 
free and inexpensive materials. Since these materials are soon out 
of print, the items should be ordered as soon after listing as pos- 
sible. 


Free and Inexpensive Learning Materials. 8th ed., Nashville: Divi- 


sion of Surveys and Field Services. George Peabody College for 
Teachers, 1957. 264 pp. 


ABSTRACTS 


Another reference guide is the type known as the abstract, digest, 
or review. In addition to providing a systematized list of reference 


sources, it includes a summary of the contents of each article. Usu- 


ally the summaries are brief, but in some publications they are 
presented in greater detail. 

One of the most useful of these references in educational research 
is worthy of detailed description. 


* Review of Educational Research. Washington: American Educa- 

tional Research Association (NEA), 1931-date. 

Published five times each year, the Review briefly summarizes 
research findings in education and related areas. The topics now 
appear in eleven major areas in three-year cycles, each issue bring- 
ing up to date the research developments of the previous three-year 
period. Since the classification of topics has been altered several 
times since the Review first appeared in 1931, the schedule of 
topics is not completely regular. 

Graduate students in education will find this publication most 
valuable, particularly as a source of brief research summaries and 


L 
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an extensive bibliography of research, both published and unpub- 
lished. Since it is so comprehensive, a detailed schedule is pre- 


sented: 


A 


1, Administration—Organization, Fiscal and Legal Aspects, School Plant 


and Management 


I:3 June, 1931 VIII:2 April, 1938 
Il:2 April 1932 VIII:4 Oct, 1938 
Il:5 Dec, 1932 X:4 Oct, 1940 

II:5 Dec. 1933 XL:2 April, 1941 
IV:4 Oct, 1934 XII:2 April, 1942 

V:2 April, 1935 XIII::4 Oct, 1943 

V:4 Oct, 1935 XIV:2 April 1944 
VII:4 Oct, 1937 XV:1 Feb., 1945 


2. Curriculum—Supervision, Teaching 


XVI:4 Oct., 
XVIL2 April, 
XVII:1 Feb., 
XIX:4 Oct., 
XX:2 April, 
XXI:1 Feb., 
XXIL4 Oct, 
XXV:4 Oct, 
XXVIII:4 Oct., 


XX:l Feb, 
XXIII:1 Feb,, 
XXVI: Feb., 
XXIX:1 Feb. 


VIIE1 Feb., 
IX:3 June, 
XVIII::6 Dec., 


1946 
1947 
1948 
1949 
1950 
1951 
1952 
1955 
1958 


1950. 
1958 
1956 
1959 


1938 
1939 
1948 


I:1 Jan, 1931 XV:3 June, 1945 
IV:2 April, 1934 XVIII:3 June, 1948 
VII:2 April, 1937 XXII:3 June, 1951 
XIL3 June, 1942 XXIV:3 June, 1954 
XXVI:2 April, 1956 
XXVII:3 June, 1957 
3. Educational Measurement—Tests 

II:3 June, 1932 VIII:3 June, 1938 
11:4 Oct, 1932 VIII:5 Dec., 1938 
II:1 Feb. 1933 XI:1 Feb, 1941 
V:8 June, 1935 XIV:1 Feb., 1944 
V:5 Dec, 1985 XVII:1 Feb. 1947 

4, Educational Psychology—Behavior, Learning, Teaching Methods 
1:4 Oct, 1931 IV:5 Dec, 1934 
I:5 Dec, 1931 V:l Feb, 1935 
II::1 Feb, 1932 VI:3 June, 1936 
Iil:4 Oct, 1933 VII:5 Dec, 1937 


5. Educational Sociology—Social Foundations, History of Education, 


Comparative Education, Human Relations 


VI:4 Oct, 1936 XII:1 Feb, 1943 
VII:1 Feb. 1937 XVI:1 Feb., 1946 
IX:4 Oct, 1939 XIX:1 Feb. 1949 
X:1 Feb, 194) XXII:1 Feb, 1952 


6. Guidance— Counseling, Pupil Personnel 


III:3: June, 1933 XII:1 Feb, 1942 
VI:2 April, 1936 XV:2 April, 1945 
1X:2 April, 1989 XVIII:2 April, 1948 


XXII:4 Oct, 
XXV:1 Feb., 
XXVHI:l Feb., 


XXI:2 April, 
XXIV:2 April, 
XXVIL2 April, 


1953 
1955 
1958 


1951 
1954 
1957 
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7. Mental and Physical Development 


Ii:2 April, 
VI: Feb., 
IX:1 Feb., 


1933 


1:36 
1939 


XIV:5 Dec. 1944 XXV:5 Dec, 1955 

XVII:5 Dec. 1947 XXVI:5 Dec, 1956 

XX:5 Dec, 1950 XXVIII:5 Dec. 1958 
XXII:5 Dec., 1952 


XL1 Dec., 1941 
8. Language Arts—Fine Arts, Natural 


Science, Mathematics, Social 


Studies 
X:2 April 1940 XV:4 Oct, 1945 XXI:4 Oct, 1951 
XI:4 Oct, 1941 XVI:2 April 1946 XXII:2 April, 1952 
XII:4 Oct, 1942 XVIII:4 Oct, 1948 XXV:2 April 1955 
XIIL:2 April, 1943 XIX:2 April 1949 XXVIIL2 April, 1958 


9. Research Methods— Statistics 
IV:1 Feb. 1934 XV:5 Dec., 
IX:5 Dec., 1939 XVIII:5 Dec., 
XIL5 Dec.,° 1942 XXI:5 Dec. 


1945  XXIV:5 Dec, 1954 
1948 XXVI:3 June, 1956 
1951 XXVII:5 Dec., 1957 


10. Special Programs—Adult Education, Leisure Education, Citizenship 


Education 


VI:5 Dec, 1936 XIV:4 Oct, 
X:5 Dec, 1940 XVI:5 Dec., 
XI:3 June, 1941 XVII:3 June, 
XI:4 Oct, 1941 XVII:4 Oct., 
XIII:5 Dec, 1943 XIX:5 Dec.? 
XIV:3 June, 1944 XX?3 June, 


11. Teacher Personnel > 
I:2 April 1931 XII:3 June, 
IV:3. June, 1934 XVL3 June, 
VII:3 June, 1937 XIX:3 June, 
X:3 June, 1940 XXII:3 June, 


1944 XX:4 Oct, 1950 
1946 XXIII:2 Spring, 1953 
1947 XXIII:3 June, 1953 
1947 XXIII:5 Dec. 1953 
1949 XXIV:1 Feb, 1954 
1950 XXIV:4 Oct, 1954 
XXVI:4 Oct, 1956 
1943 XXV:3 June, 1955 
1946 XXVIII:3 June, 1958 
1949 
1952 


* Oscar Buros, ed., Fourth Mental Measurements Yearbook. High- 
1047 pp. 

This is the most complete and authoritative summary on psy- 
chological measurement and standardized tests. Contains reviews 
on 429 books on measurement and 758 excerpts from book reviews 
appearing in 121 professional journals. Almost’ 800 standardized 
tests and scales (achievement, aptitude, interest, and personality) 
are reviewed by one, two, or three reviewers. . 

Readers are urged to refer to previous editions of the yearbook, 


land Park, N. J.: Gryphon Press, 1953. 


lst edition 1938 
2nd edition 1941 
Srd edition 1949 


for material is not duplicated from one edition to the next. 


» 
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* Book Review Digest. New York: H. W. Wilson Co., 1905-date. 


Issued monthly and cumulated semiannually, annually, and every 
five years. Signed reviews of about 4,000 books each year are taken 
from more than seventy publications. Plus and minus signs are 
used to indicate degree of favor or disfavor expressed in the reviews. 
A complete directory of publishers and authors is included. 


Book List and Subscription Books Bulletin. Chicago: American 
Library Association, 1955-date. (Formerly published as two separate 
periodicals, Subscription Books Bulletin and Booklist.) 


This reference presents an unbiased, critical analysis by expert 
librarians of atlases, encyclopedias, biographical works, dictionaries, 
and collections in terms of their usefulness and reliability for librar- 


ies or homes. It also lists all new books as they are released by 
publishers. 


Educational Abstracts. Paris: Education Clearing House, UNESCO, 
1949-date. ^ 


Issued monthly, except July and August, this publication includes 
abstracts and articles on some specific pliase of education in various 
countries of the world, such as adult education, textbooks, science 
teaching, research, visual aids, and rural education. 


Biological Abstracts. Baltimore: Union of American Biological So- 
cieties, 1926-date. 


Indexes and abstracts published literature of research in biology 
as printed in all languages. 

Child Development Abstracts and Bibliography. Washington: Na- 

tional Research Gouncil, 1927-date. 


Issued bimonthly and cumulated annually. Abstracts over twenty 
journals. 


Chemical Abstracts. Easton, Pa.: American Chemical Society, 1907- 
date. 


Issued semimonthly with annual indexes based on authors, sub- 
jects, formulas, and patent numbers. Cumulated every ten years. 
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An excellent guide to all articles on chemistry, carefully summa- 
rized. 


Earl D. Graham and Marjorie M. Mullen, eds., Rehabilitation Lifera- 

ture. New York: McGraw-Hill Book Co., Inc., 1956. 573 pp. 

Indexes and annotates 5,214 periodical articles, pamphlets, and 
books relating to the medical care, education, employment, welfare, 
and psychology of the handicapped. 


* Psychological Abstracts. Lancaster, Pa.: American Psychological 

Association, 1927-date. 

Issued monthly and indexed by subject and author annually. 
Excellent signed summaries of psychological research reports. 


Paul Farnsworth, ed., Annual Review of Psychology. Palo Alto, 
Cal.: Stanford University! 


Provides summaries of psychological literature. 


Education in Lay Magazines. Washington: Research Division, NEA, 
1948-date. 


Issued four times each year. Contains a digest of articles on edu- 
cation published in nonprofessional magazines. 


Summary of Doctoral Dissertations, 14th ed. Madison, Wisc.: Uni- 
versity of Wisconsin, 1958. 


This volume, published biennially, contains abstracts of all dis- 
sertations accepted in partial fulfillment of requirements for the 
doctor's degree at the University, and makes available to students 
everywhere the reports of doctoral research. It is cited to illustrate 
the type of publication issued by nearly all institutions granting 
the doctoral degree. 


ENCYCLOPEDIAS 


Encyclopedias provide concise articles on a number of subjects. 
Written by specialists, they provide a convenient source of informa- 


54 THE USE OF REFERENCE MATERIALS 


tion with a minimum of searching. In addition they often include 
illustrations, maps, diagrams, and bibliographies. 

General encyclopedias cover practically all topics. A number 
of excellent specialized encyclopedias present more detailed ma- 
terial in restricted areas of knowledge. Both general and educa- 
tional encyclopedias are described in this section. 


* Encyclopaedia Britannica, |4th ed. Chicago: Encyclopaedia Britan- 

nica Corp., 1949, 24 volumes. 

The most famous and complete encyclopedia in the English lan- 
guage. Most of the important articles are signed. Volume 24 
contains a comprehensive detailed index, which should be used 
to be sure that all pertinent information is found. The Britannica 
Book (1931-date) of the Year, published annually as a supplement, 


covers events of the preceding year and brings the encyclopedia 
up to date. 


* Encyclopedia Americana. "New York: Americana Corporation, 33 
volumes. 


A fine general encyclopedia with especially good information on 
American places, persons, organizations, and institutions. "The arti- 
cles are usually shorter than those in the Britannica. Continuous 
revision keeps it reasonably up to date. The Americana Annual 


is published each year as a supplement to cover events of the pre- 
ceding year. 


Collier's Encyclopedia. New York: P. F. Collier and Son, 1954, 20 
volumes. 


An excellent illustrated encyclopedia. Volume 20 contains a 


graded bibliography in many subject areas. An annual supple- 
ment is published each year. 


* Columbia Encyclopedia in One Volume. New York: Columbia Uni- 
versity Press, 1953. 2203 pp. 


A handy, one-volume, up-to-date, quick desk reference. It con- 
tains over 70,000 articles, which are necessarily short. 


There are no 
illustrations. 
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Lincoln Library of Essential Information, 22nd ed. Buffalo: Frontier 

Press, 1955. 

This one- or two-volume encyclopedia is a concise general refer- 
ence, although not as complete'as a standard general encyclopedia. 


World Book Encyclopedia. Chicago: Field Enterprises, 1955, 19 

volumes. 

An excellent juvenile encyclopedia written authentically in clear 
style. This work is also helpful to adults who want brief articles. 


American Yearbook. New York: Thomas Nelson and Sons (publisher 

varies], 1910-19, 1925-date. 

Contains accounts of events of the year in various fields such as 
politics, economics, social affairs, and the arts. Carefully indexed, 
making fact-searching convenient. 


Facts on File. New York: Facts on File, Inc., 1940-date. 


An eight-page, weekly, current encyclopedia. Covers world news 
indexed for quick fact-finding. Thousands of newspapers and press 
“releases and hundreds of periodicals are searched for information. 
The advisory board is composed of distinguished scholars in each 
field. Indexes are cumulated monthly, quarterly, and annually. 


Encyclopedia of the Social Sciences. New York: The Macmillan Co., 

1930-35. 15 volumes. 

Prepared under the direction of ten learned societies that are 
international in scope. Treats topics in all of the social sciences, 
including anthropology, economics, education, ethics, geography, 
history, law, philosophy, political science, psychology, social work, 
sociolgy, and statistics. Excellent biographies of important social 
scientists, and skillful historical treatment of many topics. 


* Walter S. Monroe, ed., Encyclopedia of Educational Research. 
American Educational Research Association. New York: The Mac- 
millan Co., 1950. 1520 pp. P / 
Cites outstanding research on educational problems. Each arti- 
cle is written by a specialist, and an excellent bibliography follows 
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each article. A new edition, scheduled for publication in 1960, will 
include reports of educational research conducted and published in 
foreign countries as well as in the United States. 


Paul Monroe, ed., Cyclopedia of Education. New York: The Mac- 
millan Co., 1911-13. 5 volumes. 


Old but useful reference in covering basic information, particu- 


larly of a historical or biographical nature in education. It covers 
all countries and all periods. 


Henry D. Rivlin and H. Schueller, eds., Encyclopedia of Modern Edu- 
cation. New York: Philosophical Library, 1943. 902 pp. 
A concise, nontechnical treatment of basic educational topics. 


It is useful for lay readers, or to supplement the Cyclopedia of Edu- 
cation mentioned above. 


l. L. Kandel, ed., Educational Yearbook of the International Institute 


of Teachers College. New York: Bureau of Publications, Columbia 
University, 1928-44. 20 volumes. 


An excellent reference for comparative education, describing vari- 


ous national systems of education. Most volumes are devoted to 


some particular aspect of education, such as adult education, rural 
education, ete. 


J. A. Lauwerys and others, eds., Yearbook of Education. New York: 

World Book Co., 1953-date. 

This yearbook is prepared under the joint responsibility of the 
University of London Institute of Education and Teachers College 
of Columbia University. Each issue is devoted to some aspect of 
education, which is described at length by more than fifty eminently 
qualified persons representing various countries. 

Each year a different aspect of education is treated. 


1953 Status and Position of Teachers 


1954 Educational and Technological Development 
1955 Educational Counseling 
1956 Education and Economics 


— Cu PP 
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1957 Education and Philosophy 
1958 The Secondary School Curriculum 


G. B. Jeffery, ed., Yearbook of Education. University of London, 
Institute of Education. London: Evans Bros., Ltd., 1932—40, 1948- 
date. 

This yearbook is not to be confused with the one mentioned 
above. This yearbook contains signed articles on all phases of edu- 
cational development in all English-speaking and major European: 
countries. 


International Yearbook of Education. Geneva, Switzerland: Inter- 
national Bureau of Education, UNESCO, 1948-date. 
, Presents a review of educational developments for the previous 
year in the United States, Canada, and forty-three foreign coun- 
tries. 


Lloyd E. Blauch, ed., Education for the Professions. Washington: 
U. S. Dept. of Heglih, Education and Welfare, 1955. 317 pp. 
, A comprehensive treatment of professional education in the 
United States, covering every field from agriculture to veterinary 
medicine. The strengths and weakness of each program are ana- 
lyzed. Contains descriptions of schools, accrediting associations, 
degree requirements, curricula, and current problems in each area. 


Excellent bibliography. 
Ralph B. Winn, ed., Encyclopedia of Child Guidance. New York: 
Philosophical Library, 1943. 456 pp. 
Articles initialed by writers who can be identified under list of 
contributors. 


Oscar J. Kaplan, ed., Encyclopedia of Vocational Guidance. New 
York: Philosophical Library, 1948. 2 volumes. 


Designed for professional counselors, but does not cover all 
phases of guidance in detail. Analysis of a number of standardized 


tests included. 
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Eric Blom, ed., Grove's Dictionary of Music and Musicians, 5th ed. 

New York: The Macmillan Co., 1940. 6 volumes. 

This is actually a musical encyclopedia. Over 500 contributors, 
in signed articles, write on music terminology, history, theory, com- 
posers and compositions, instruments, and artists. 


ALMANACS, YEARBOOKS, DIRECTORIES, AND HANDBOOKS 

This general classification of references includes the types of pub- 
lications that supplement encyclopedias. The emphasis is upon a 
great number of current detailed facts, rather than on written arti- 
cles of a background nature. They supply concise factual informa- 
tion of a statistical or identifying nature. One turns to a reference 
of this kind for a specific item of information, such as the enroll- 
ment of the University of Wisconsin. 'The information is con- 
veniently classified and readily available. 

The more general sources are presented first, followed by those 
dealing with more specialized areas of information. 


* World Almanac—Book of Facts. New York: World Telegram 

Corp., 1868-date. ‘ 

Published annually, this inexpensive volume is the most compre~ 
hensive and most frequently used source of miscellaneous informa- 
tion. Statistical data in social, political, religious, sports, educa- 
tional, and economic affairs are presented. A chronology of impor- 
tant events of the previous year is included. An alphabetical index 
is found in the front of each volume. 


* John Kieran, ed., Information Please Almanac. New York: The 

Macmillan Co. (publisher varies), 1933-date. 

This general almanac is similar to the World Almanac, but con- 
tains some information not found there. The index is found at the 
back of each volume. 


* Statistical Abstract of the United States. Washington: Depart- 

ment of Commerce, Supt. of Documents, U. S. Gov't. Printing Office, 

1897-date. 

This important volume includes statistical data collected by all 
agencies of the government, as well as some collected by private 
agencies. It covers statistical data on all topics. Of interest to 
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students in education is the ‘data on students, institutions, enroll- 
ment, salaries, expenditures, and literacy. All levels, from preschool 
to higher education, are covered. 


Statesman's Yearbook. New York: The Macmillan Co., 1864-date. 

A compilation of important data about the various governments 
of the world. All areas of governmental activity are covered. 
Authentic educational information is included. 


Book of the States. Chicago: Council of State Governments, 1935- 

date. 

Published every other year, this publication presents statistical 
data on each of the forty-eight states. Names of chief officials and 
numerous facts are included. 


* Biennial Survey of Education in the United States. Washington: 
Dept. of Health, Education and Welfare. U. S. Gov't. Printing’ 
Office, 1916-date. 

This official publication presents detailed statistical information on 


all phases of education in the United States. 


Yearbook of the United Nations. New York: United Nations, Colum- 
bia University Press, 1946-date. 
Summarizes the activities of the various agencies of the United 


Nations. 


Schoolman's Almanac. New York: Educator's Washington Dispatch, 

1947-date. 

Summarizes educational events of the previous year, presents 
calendar of events of current year, and summarizes significant edu- 
cational trends and developments. A valuable: source of miscella- : 
neous current information about education in America. 1 


* Robert C. Woellner and M. Aurilla Wood, eds., Requirements for 

Certification of Teachers, Counselors, Librarians and Administrators 

in Elementary and. Secondary Schools and Junior Colleges, 23rd ed. 

Chicago: The University of Chicago Press, 1958-59. 13l-pp. 

The title describes the purpose of the volume, which presents 
data for each of the forty-eight states and the territories. 
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A Manual on Certification Requirements for School Personnel in the 
United States. Washington: Dept. of Health, Education and Wel- 
fare. U. S. Gov't. Printing Office, 1957. 232 pp. 


Certification practices of the forty-eight states and territories, 
Less specific than the Woellner-Wood volume. 


Handbook on Teacher Education, Bulletin #192, 
of Indiana, Division of Teacher Training and Lic 
of Public Instruction, 1954. 96 PP- 


Indianapolis: State 
ensing, Department 


A complete guide to teacher education and teaching requirements 


in Indiana as established by law and rules of the Department. 
(Other states have comparable publications. ) 


Eileen C. Graves, ed., Ulrich's Periodicals Directory, 8th ed. New 
York: R. R. Bowker Co., 1956. 730 PP- 1 
A classified list of over 9,000 

Periodicals are arranged alphabet 

and address of publisher and su 


foreign and domestic periodicals. 
ically by subject and title, Name 
bscription price are listed. 


America's Educational Press Yearbóok. 
Press Association, 1926-date, 


A classified list of periodicals published in the United States that 
deal primarily with education. Names of periodicals are indexed 
alphabetically and grouped by subject areas. Names of editors, 


addresses of publishers, number of issues per year, and subscrip- 
tion prices are given. 


Washington: Educational 


Union List of Serials in Libraries of the United States and Canada. 
New York: H. W. Wilson Co., 1927. 


A listing of the periodicals, foreign and domestic, held by over. 


225 United States ànd Canadian libraries. This listing does not 


include government publications or other highly specialized ma- 
terials, 


* Leona H. May, ed., Patterson's American Education. 
Educational Directories, Inc., 1904-date. 


Lists, by states, school offici 
school systems in the country, 


Chicago: 
Vol. 54, 1957-58. 651 pp. 


als for practically all schools and 
both private and public. Schools are 
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listed alphabetically, with names of superintendents, directors, prin- 
cipals, supervisors, librarians, and business officials. 


* Educational Directory. U. S. Office of Education. Washington: 
U. S. Gov't. Printing Office, 1912-date.. 


Revised annually, this directory, issued in four separate parts, in- 
cludes the following data: 


. Principal state school officers. 

. County and city school officers (over 2500 population). 

. Colleges, universities, and junior colleges, with their principal offi- 
cers. 

. Educational associations and their officers. 


[^M e 


A 


Jesse P. Bogue, ed., American Junior Colleges, 4th ed. Washington: 
American Council on Education, 1956. 537 pp. 


Complete data on junior colleges, both private and public. 


Mary Irwin, ed., American Universities and Colleges, 7th ed. Wash- 

ington: American Council on Education, 1956. 1054 pp. 

Published every four years, this standard reference work on higher 
education gives detailed information on 969 institutions. It in- 
cludes information on admission, method of control, degree require- 
ments, tuition and fees, departments, staff, enrollment, library, hous- 
ing, foreign students, accreditation, graduate work, and military 
programs. 

Clarence E. Lovejoy, ed., Lovejoy's Complete Guide to American 


Colleges and Universities, 4th rev. ed. New York: Simon and Schus- 
ter, 1956/57. 266 pp. 


This work is directed towards the prospectiye college student 
and includes information useful in choosing a school. 


Frederick W. Ness, ed., A Guide fo Graduate Study: Programs Leud- 

ing to the Ph.D. Degree. Washington: Association of American Col- 

leges, 1957. 335 pp. 

A useful reference to assist undergraduates in planning for gradu- 
ate study, providing a basis for the selection of a graduate institu- 


tion. 


62 THE USE OF REFERENCE MATERIALS 


Study Abroad, International Handbook. Paris: UNESCO, 1955. 

308 pp. 

A comprehensive directory and guide giving detailed informa- 
tion on fellowships and awards for foreign study. Funds, founda- 


tion activities, school requirements, and teacher exchange informa- 
tion is included. 


M. M. Chambers, ed., Universities of the World Outside the United 
States. Washington: American Council on Education, 1950. 924 
pP. 

Includes information on over 2,000 institutions of higher learning 
in more than seventy countries, It includes information on name, 
location, history, admission, degree requirements, language of in- 
struction, grading system, staff enrollment, foreign students, build- 
ings and campus, finances, and administrative officers, 


Martena T. Sasnett, Educational Systems of the World: Interpreta- 
tion for Use in Evaluation of Foreign Credentials. Los Angeles: Uni- 
versity of Southern California Press, 1952. 888) pp. 


An especially useful reference for college registrars for setting up 
American equivalencies for study done abroad. 


Raymond J. Young, ed., Directory of Educational Research Agencies 
and Studies. Bloomington, Ind.: Phi Delta Kappa, 1957. 80 pp. 
This work lists hundreds of educational research agencies, indi- 


viduals in charge of the agencies, types of research carried on, and 
listing of topics. 


NEA Handbook for Local, State and National Associations. Wash- 
ington: NEA, 1945/46-date. 


Contains comprehensive reports and listings of state and national 
officers of the NEA and affiliated departments and associations. 
This includes information on state teachers’ associations and on 


the World Confederation of Organizations of the Teaching Profes- 
sion. E 
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Mary L. Ely, ed., Handbook of Adult Education in the United States. 

New York: Institute of Adult Education, Teachers College, Columbia 

University, 1948. 555 pp. 

Contains signed articles of the survey type dealing with various 
aspects of adult education. 


Negro Handbook. New York: Current Reference Publications, 1942- 

date. 

Compiles a great deal of data on events of the previous year as 
related to the Negro and his welfare. It includes such topics as 
crime, population trends, publications, sports, civil rights, religious 
affairs, and educational and welfare activities. 


Morris Fine, ed., American Jewish Yearbook, American Jewish Com- 

mittee. Philadelphia: Jewish Publishing Society of America, 1899- 

date. 

A comprehensive statistical reference on all phases of Jewish life 
throughout the world. 


American Foundations and, Their Fields. New York: American Foun- 

dation Information Service, 1955. 744 pp. 

Includes such information as names and addresses of foundations, 
officers, history, purposes, donors, activities, assets, and expenditures. 


Encyclopedia of American Associations. Detroit: Gale Research 

Co., 1956. Supplements | and Il, 1957. 401 pp. 

A directory of national associations of national scope, including 
business, scientific, educational, health, social welfare, and others 
of a more general nature. Alphabetical listing of associations in- 
cludes information on membership, address, name of executive sec- 
retary, and a short statement of purpose. 
erican College Fraterni- 
1084 pp. 


al fraterni- 


George S. Lasher, ed., Baird's Manual of Am 
ties. Menasha, Wisc.: George Banta Co., 1957. 


Includes detailed information on professional and soci 
ties, sororities, and honor societies. 
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Ann J. Richter, ed., American Library Directory. New York: R. R. 

Bowker Co., 1951. 844 pp. 

A comprehensive guide to public, private, institutional and col- 
legiate libraries in the United States and Canada. Arranged alpha- 
betically by states and cities, it includes such information as num- 
ber of volumes, special collections, salaries of staff, budgets, and 
affiliation. 


Administrative Handbook for the Schools of Indiana. Indianapolis: 
State of Indiana, Department of Public Instruction, 1958. 380 pp. 
A guide to the duties and responsibilities of school administra- 
tors and board members. (Other states have comparable hand- 


books. ) 


Handbook of the Indiana High School Athletic Association. Indian- 

apolis: IHSAA, 1904-date. 262 pp. 

Published annually, this handbook describes the functions of the 
association, the minutes of the Board of Control, and the records of 


high school teams in interscholastic competition. (Most states have 
a comparable publication. ) 


Butler University Bulletin. Indianapolis, Indiana, 1854-date. 


A college catalogue yields a great deal of information about an 
institution, its history, courses of study, admission requirements, de- 
grees granted, campus, buildings, tuition and fees, enrollment, and 
staff. This is often the best source of information about a particular 
school, containing much more detailed information than is found in 
any of the general references. 

Most colleges and universities maintain a rather complete file of 
the catalogues of other institutions, either in the library or in the 


Admissions Office, 
BIOGRAPHICAL REFERENCES 


Educational workers often find that they need information about 
another educator or a prominent person outside the field of educa- 
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tion. Some of these occasions relate to the problems of educational 
research, while others concern professional contact of one kind or 
another. 

A partial list of situations in which detailed information of a bio- 
graphical nature would be helpful is: 

1. To help evaluate writings. Who is the author of a textbook, 
article, or report? Is he a recognized authority? What is his ex- 
periential background? 

2. To recommend a speaker for a professional meeting. 

3. To prepare a press release about an outside speaker. 

4, To introduce a visiting speaker. 

5. To prepare.for an important interview. 

6. To correspond with a person with greater understanding of his 
background. 

7. To choose an authority with whom to work professionally. 
This may involve the choice of a major professor for advanced 
study. 

8. To aid in recommending an individual for an honor, such as an 
award or an honorary degree. 

Fortunately, there are a number of sources of information about 
the famous and the not-so-famous. If the person is really outstand- 
ing, a general reference will supply the needed information. If he is 
not so prominent, a specialized source must be consulted. 

Before listing a number of recognized sources of biographical 
data, a word of caution may be advisable. Many of the hundreds 
of these current biographical references have been criticized as 
vanity publications, including in their listings persons of little dis- 
tinction who are anxious to get their names in the publication. 
Another criticism concerns the possible lack of validity of some 
of the information. Since persons listed usually send in their own 
data (which is not always carefully checked), some inaccuracies 
may result. Another criticism, that important personalities are not 
listed, is sometimes true, for the listings are usually submitted as 
the result of an invitation by the publisher. 

Without questioning the motives of the publishers, who finance 
their publication by fees from those listed, the reader is urged to 
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evaluate the biographical data carefully. These publications, in 
spite of their limitations, provide a reasonably useful source of bio- 
graphical information. 

Included in the sketches are rather detailed bits of information, 
such as present position and title, date and place of birth, names 
of parents, college degrees, name of spouse, name of spouse's 
parents, names of children, positions previously held (listed chrono- 
logically), honorary positions, membership in organizations, title of 
doctoral dissertation, books published, contributions to periodicals, 
military experience, travel, and hobbies. 

Limited information on educators not listed in one of these refer- 


ences may be found in the catalogue of the college or university 
where the person teaches. 


* Current Biography. New York: H. W. Wilson Co., 1940-date. 


Issued monthly and cumulated yearly, this reference covers 
celebrities: kings, prime ministers, presidents, Nobel prize winners, 
senators, cabinet members, Supreme Court justices, and radio, film, 


television, and stage personalities. The yearly cumulation is en- 
titled Current Biography Yearbook. 


*Who's Who in America Current Biographical Reference Service. 

Chicago: Marquis Co., 1940-date. 

This monthly publication, by the publisher of Who’s Who in 
America, covers individuals of all countries. It does not duplicate 
the names listed in Current Biography. 


Biography Index. New York: H. W. Wilson Co., 1946-date. 


A quarterly index of biographical material found in more than 
1300 periodicals and in the various indexes of the H. W. Wilson 


Company. Articles are indexed by name, profession, and occupa- 
tion. 


Webster's Biographical Dictionary. Springfield, Mass.: G. & C. 
Merriam Co., 1943. 


Contains over 40,000 brief biographical sketches, from a few lines 
to more than a page in length. It is useful for identifying persons 
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of any nationality from any period of history. Proper pronuncia- 
tion of names is indicated. It includes some living persons. 


Dictionary of American Biography. New York: Charles Scribner's 

Sons, 1928-36. 20 volumes. 

This biographical reference, written by recognized authorities, 
contains information on more than 15,000 men and women; pre- 
pared under the direction of the American Council of Learned 
Societies, 


* Who's Who in America. Chicago: Marquis Co., 1899-date. 


Published every other year, this general reference is considered 
one of the most reliable. 


Who Was Who in America. Chicago: Marquis Co., Vol. I, 1897- 
1942; Vol. Il, 1943-50. 


These references list deceased persons who were prominent. 
Encyclopedias also give information about famous deceased persons. 
American Men of Science. Lancaster, Pa.: Science Press, 1949. 
Vol. I 1955 Physical Sciences 


Vol. II 1955 Biological Sciences 
Vol. III 1956 Behavioral Sciences 


* J. Cattell and E. E. Ross, eds., Leaders in Education. Lancaster, 


Pa.: Science Press, 1948-date. 
Contains data on more than 17,000 American educators. 


* Robert C. Cook, ed., Who's Who in American Education. Nash- 
ville, Tennessee: Who's Who in American Education, Inc., 1928-date. 


Published biennially, this publication lists some less-than-promi- 


nent, as well as prominent, educators. 
Presidents cf American Colleges 


Roberte Cooked uree aa Who's Who in American Educa- 


and Universities. Nashville, Tenn.: 

tion, 1955-date. 

Formerly published as penan 
leges and Universities. Includes da oe 
1857 institutions, indexed by state and by institution. 


nd Professors in American Col- 
ta on officials of 1462 out of 
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DICTIONARIES 


Students in education need to know the precise meaning of words 
in order to read with understanding and to write clearly and suc- 
cinctly. The large unabridged dictionaries are recommended for 
their completeness and presentation of exact meanings. For ac- 
ceptable definitions of technical terms used in education, psychol- 
ogy, or sociology, specialized dictionaries are most helpful. 


* Webster's New International Dictionary of the English Language, 
2nd ed., unabridged. Springfield, Mass: G. & C. Merriam Co., 


1957. 3214 pp. 
Contains over 600,000 words, including a historical development 
of the meaning of words. Also included are antonyms, synonyms, 


symbols and abbreviations, and pronouncing guides to geographi- 
cal and biographical names. 


Oxford English Dictionary. Oxford: Clarendon Press, 1933. 12 vol- 
umes and supplements, 1933. 
Includes about 415,000 words, with complete origin of every 


word in the language, excluding only words obsolete by 1150 and 
some slang. 


Funk and Wagnall's New Standard Dictionary of the English Language. 
New York: Funk and Wagnalls Co., 1950. 2895 pp. 


Another fine unabridged dictionary, 


* Roget's Thesaurus of Words and. Phrases. New York: Grosset and 
Dunlap, Inc., 1947. 


A thesaurus is the opposite of a dictionary. When you have an 
idea, you look for the most appropriate word to convey that idea, 


Synonyms, antonyms, and words frequently associated are listed 
together. 
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Js Rodale, The Word Finder. Emmaus, Pa.: Rodale Press, 1947, 

1317 pp. 

A valuable writing guide that Provides the tight adjective, verb, 
or adverb to remedy sluggish sentences, and to embellish ideas, 


* Carter V, Good, ed., Dictionary of Education. New York: Mc- 
Graw-Hill Book Co., Inc., 1959. 


This fine educational dictionary covers 17,000 technical and pro- 
fessional terms, including related terms from the fields of sociology, 
philosophy, Psychology, and social psychology. F oreign educa- 
tional terms used in comparative education writings are included, 


, Horace B. English and Ava C. English, Comprehensive Dictionary of 
Psychological and Psychoanalytical Terms. New York: Longmans, 
Green & Co., Inc., 1958, 534 PP- 


Over 13,000 terms are included in this specialized dictionary, de- 
fined in nontechnical language. 


Henry P. Fairchild, ed., Dictionary of Sociology. New York: Philo- 
sophical Library, 1944. 342 PP- 


Curtis A. Bartholomew, ed., Epithetology. Red Bank, N. J.: Commer- 

cial Press, 1948. 207 PP- 

A complete guide to recognized educational degrees, ie ENG 
and honorary, A historical presentation of academic deg 


included, 


i 7 UTS: 
picHonary of Occupational Titles, 2nd ed. A. Ana Office, 
Dept. of Labor Employment Service, U. S. Gov't. 


1949. 1518 pp. OMM 
Lists 39,000 job titles and 25,000 job dee v peur 
tional Counseling and in the study of occupations 
Processes. 
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QUOTATION SOURCES 


The use of an appropriate quotation often adds to the effective- 
ness o£ a speech or written report. The writer once heard a speaker, 
commenting on the dangers of overspecialization in the graduate 
program, paraphrase the words of Nicholas Murray Butler, late presi- 
dent of Columbia University, who defined a specialist as one who 
learns more and more about less and less until he knows everything 
about nothing. The memory of this interesting quotation has re- 
mained, long after the speaker and the speech had been forgotten. 

In using quotations it is important to insure their accuracy and 
to give credit to the author. If it seems to add effectiveness to 
paraphrase or alter the quotation for specific application, that fact 
should be acknowledged. 

Most libraries have a number of references that provide useful 
quotations and their sources. They are usually indexed by subject, 
author, or first line. It has been suggested that educators build 
their own file of useful quotations, listing them on file cards placed 
under appropriate subject headings. ' 


* John Bartlett, Familiar Quotations, 13th ed. Boston: Little, Brown & 

Co., 1955. 1614 pp. 

An old standard reference that has been revised and brought up 
to date many times. Quotations are arranged chronologically by 
authors. An excellent index makes it possible to find a quotation 
when only a word or two is remembered. 


Sir Paul Harvey, Oxford Companion to Classical Literature. Oxtord: 
Clarendon Press, 1937. 


An excellent guide to classical allusions in everyday use. 


Jehiel H. Hoyt, Hoy?'s New Cyclopedia of Practical Quotations, 


Kate L. Roberts, ed. New York: Funk and Wagnalls Co., 1940. 
1343 pp. 


Anothez old reference, frequently revised. Indexed by subject 
and author. 
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Burton Stevenson, Home Book of Quotations, Classica! and Modern, 

5th ed. New York: Dodd Mead & Co., 1947. 2812 pp. 

Includes over 50,000 extracts from all ages and parts of the world. 
Indexed by subject and author. 


ATLASES AND GAZETTEERS 


Reading professional literature with understanding and preparing 
reports effectively may depend upon reference to good, up-to-date 
maps. Excellent atlases, or collections of maps, and gazetteers, or 
geographical dictionaries, are available in most libraries. Since 
political boundaries change frequently in our modern world, it is 
important to use as recent revisions of these publications as pos- 
sible. 

Rand McNally Commercial Atlas and Marketing Guide. New York: 

Rand McNally & Co., 1876-date. 


An excellent large atlas with particular emphasis upon the United 
States. Revised annually, the atlas must be returned to the pub- 


` jisher for replacement. 


* Rand McNally Cosmopolitan World Atlas. New York: Rand Mc- 

Nally & Co., 1949. 335 pp. 

A smaller but adequate atlas, with emphasis upon world geog- 
raphy. 

The following atlases are also useful: 


Cram's Unrivaled Atlas. Indianapolis: George F. Cram Co., 1952. 
400 pp. 

Hammond's Complete World Atlas. 
1950. 375 pp. 

John Millett, ed., Atlas of Higher Educ 
New York: Commission on the Financing o! 


bia University Press, 1952. 57 pp- 
howing the location of collegiate institu- 


ducation statistics by states. 


New York: Hammond Co., 


ation in the United States. 
f Higher Education, Colum- 


Contains outline maps $ 
tions, and includes higher e 
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GOVERNMENT PUBLICATIONS 


An excellent source of educational information is the great num- 
ber of publications of the various agencies of the federal govern- 
ment. The publications consist of bulletins, leaflets and circulars, 
directories and handbooks, statistical reports, bibliographies, and 
research studies. 

Several guides are especially helpful in locating these references. 


* Ann M. Boyd, United States Government Publications. New York: 
H. W. Wilson Co., 1949. 627 pp. 


An excellent compilation of government documents of all kinds. 
Included is information on United States depositories in state and 
territorial libraries, service academies, and land-grant colleges. 
These depositories maintain a complete file of recent government 
documents. Older documents will probably be found in older de- 
pository libraries. 


Herbert S. Hirshberg and Carl H. Melinat, Subject Guide to United 
States Government Publications. Chicago: American Library Asso- 
ciation, 1947. 228 pp. 

This reference lists the most important government publications 


under alphabetical topic listings, with short descriptive notes for 
many of the items. 


W. Phillip Leidy, A Popular Guide to Government Publications. New 

York: Columbio University Press, 1953. 296 pp. 

This excellent reference gives an annotated bibliography on gov- 
ernment documents and instructions on their use. Quasi-govern- 


ment agency publications such as those of the Pan-American Union 
are listed. 


United States Department of Health, Education and Welfare, Office 

of Education. Publications Relating to Education. Price List #31. 

Washington: Superintendent of Documents, U. S. Gov't. Printing 

Office. - 

This publication, free upon request, lists documents alphabeti- 
cally by subject, with brief annotation, price, and order blank. 


am 
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SCHOOL LAW REFERENCES 


All professional workers should have some familiarity with the 
legal aspects of education. Many graduate students, particularly 
those specializing in the field of educational administration, will 
need to know where to find the legal principles surrounding the 
work of the school board, the administrator, and the teacher. This 
may involve actually studying the laws and court decisions in which 
the laws are interpreted. 


Legal encyclopedias 


* William Mack and Donald J. Kiser, eds., Corpus Juris Secundum, 
_ Vols. 78 and 79. New York: American Law Book Co., 1937. 


This work has replaced the older volume Corpus Juris, Vol. 56, 
for so long a standard statement of American School Law. (See 
Topic, Schools). Annual pocket supplements are available. 


* American Jurispsudence. Rochester, N. Y.: Lawyer's Cooperative 

Publishing Co., 1936. 

This series has replaced the older series Ruling Case Law. (See 
Topic, Schools, Vol. 47.) 


Indexes 
Index fo Legal Periodicals and Law Library Journal. New York: 
H. W. Wilson Co., 1908-date. 


Current coverage of over 100 legal periodicals. 


State Law Index. Washington: Library of Congress, 1929-date. 


Abstracts 
R. R. Hamilton, ed., National School Law Reporter. New London, 
Conn.: Arthur C. Croft, March 1955-date. 


Formerly known as Bi-Weekly School Law Letter ( 1951-55). 


A biweekly, loose-leaf publication, discussing school law cases 
with excerpts from court decisions. Concise summary by editor is 


included. Indexed. 
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School Teacher's Day in Court. Washington: Research Division, 
NEA, 1950-date. 


Issued annually, deals with problems involving teachers. Con- 


tains statistical analysis and abstracts of court cases of previous year. 


Pupil's Day in Court. Washington: Research Division, NEA, 1950- 
date. 


Deals with cases directly concerned with public school pupils. 


High Spots in State School Legislation. Washington: Research Divi- 
sion, NEA, 1949-date. 


An annual summary of significant school law cases. 


Textbooks on school law 


Newton Edwards, The Courts and the Public Schools, rev. ed. Chi- 
cago: The University of Chicago Press, 1955. 594 pp. 


Lee O. Garber, Handbook of School Law. New London, Conn.: 
Arthur C. Croft. 165 pp. 


The legal status of school problems is indexed for handy refer- 
ence. Uses the question-answer methoc of presentation. 


Lee Garber, ed., Law and the School Business Manager. ‘Danville: 
Il: Interstate Printers and Publishers Inc., 1957. 331 pp. 


Robert R. Hamilton, Legal Rights and Liabilities of Teachers. 
Laramie, Wyo.: School Law Publications, 1956. 95 pp. 


A nontechnical presentation of school law and court decisions 
affecting school problems. 


Robert R. Hamilton and Paul Mort, The Law and Public Education, 
With Cases. Chicago: Foundation Press Inc., 1944. 579 pp. 


Robert R. Hamilton and E. E. Reutter, Legal Aspects of School Board 
Operation. New York: Bureau of Publications, Teachers College, 
Columbia University, 1958. 199 pp. 


Wendell Huston, Schoo! Laws of the 48 States. Seattle: Wendell 
Huston Co., 1947. 


Loose-leaf publication with federal and state supplements. 
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School Law of Indiana. Indianapolis: State of Indiana, Department 

of Public Instruction, 1949. Cumulative pocket supplement biennially. 

A complete summary of statutes, court decisions and opinions 
of the State Attorney General Most states have a comparable 
publication. 

Pauli Murray, State Laws on Race and Color. Cincinnati: Woman's 

Division of Christian Service, Board of Missions and Church Extension 

of the Methodist Church, 1950. 746 pp. 

Discusses laws dealing with segregation and discrimination in 
areas of education, housing, transportation, and employment. 


Madeline K. Remmlein, School Law. New York: McGraw-Hill. Book 

Co., Inc., 1950. 376 pp. 

Presents legal problems of teacher and pupil personnel; includes 
extracts from statutory and case materials. 


Madeline K. Remmlein, The Law of Local Public School Administra- 


tion. New York: McGraw-Hill Book Čo., Inc., 1953. 271 pp. 


' Discusses legal problems that confront school administrators; 


includes important court decisions. 


Harry R. Trusler, Essentials of School Law. Milwaukee: Bruce Pub- 
lishing Co., 1927. 478 pp- 
An old but still useful reference on legal principles. 


J. F. Weltzin, The Legal Authority of the American Public School. 
Grand Forks, N. D.: Mid-West Book Concern, 1931. 286 pp. 


A study of liabilities to damages. 


Yearbooks : 
M. M. Chambers, ed., Yearbook of School Law. American Council 
on Education, 1933—42. 
Digests of court deci: 

articles on legal principles. 


sions affecting schools, as well as feature 
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* Leo O. Garber, ed., Yearbook of School Law. Philadelphia: Uni- 
versity of Pennsylvania. 1950-date. 


Continues the yearbook cited above. 


Advanced legal research 


The advanced student of legal research may need to consult pri- 
mary references. In addition to the general statutes published by 
each state and kept up to date by cumulative supplements or pocket 
reports, a number of other sources are available. 


American Digest System. St. Paul, Minn.: West Publishing Company. 


A digest of all law cases from 1658 to the present, published 
under seven series units, with cases classified by topic and subtopic, 


state, name, and source, Key numbers are also provided for cross 
reference purposes. 


Century Digest 1658-1896 
First  Decennial Digest 1896-1906 
Second E r 1906-1916 
Third T *"  * 1916-1926 
Four i 3 1926-1936 
Fifth = eC 1936-1946 
General Digest 1946— 


For a complete analysis of the written decisions of the court, the 
National Reporter System may be used. 


National Reporter System. St. Paul, Minn.: West Publishing Com- 

Pany. 

Published severa! times per year, these volumes include all cases 
from all courts in all states, giving the actual written opinion of the 


court. The system is divided into regional reporters, covering geo- 
graphical areas, 


Atlantic. Reporter, 1886-date. Covers Connecticut, Delaware, 


Maine, Maryland, New Hampshire, New Jersey, Pennsylvania, and 
Vermont. 
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Northeastern Reporter, 1885-date. Covers Illinois, Indiana, Massa- 
chusetts, Ohio, New York, and Rhode Island. 


Southeastern Reporter, 1887-date. Covers Georgia, North Carolina, 
South Carolina, Virginia, and West Virginia. 

Southern Reporter, 1887-date. Covers Alabama, Florida, Louisiana, 
and Mississippi. 

Southwestern Reporter, 1887-date. Covers Arkansas, Kentucky, 
Missouri, Tennessee, and Texas. 

Pacific Reporter, 1884-date. Covers Arizona, California, Colorado, 
Idaho, Kansas, Montana, Nevada, New Mexico, Oklahoma, Oregon, 
Utah, Washington, and Wyoming. 

Northwestern Reporter, 1879-date. Covers lowa, Michigan, Minne- 
sota, Nebraska, North Dakota, South Dakota, and Wisconsin. 


New York Supplement, 1888-date. 
Federal Reporter, 1880-date. 


This series reports cases decided in, the federal circuit court of 
appeals, federal district court, and other federal courts. 


‘Supreme Court Reporter, 1882-date. 


This series reports decisions of the United States Supreme Court 
since 1882. Earlier reports of the court were issued under the 


names of various court reporters. 


American Law Reports, Annotated. Rochester, N. Y.: Lawyers 
Cooperative Publishing Company, 1919—48. 
with controversial opinion, cov- 


A series of selected cases dealing 
The volumes are issued serially, 


ering both state and federal courts. 

year by year. A second series was started in 1948. 
Shephard's Citations to Statutes. Colorado Springs, Colo.: The 

Frank Shephard Company. o 

A periodical that cites all subsequent court applications, citations, 

ons of any and all laws. Cases are pub- 


interpretations, or revisi i 
rpretation of the National Reporter 


lished by states and by geographic divisions 
System. 
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PERIODICAL SOURCES OF RESEARCH REPORTS 


While many periodicals include an occasional research report, a | 
limited number devote a major portion of space to direct reports 
of scholarly research studies in education and in closely related 
areas. 


Educational and Psychological Measurement 

Journal of Educational Research 

Journal of Experimental Education 

Research Bulletins of the National Educational Assn. 

Phi Delta Kappan 

Journal of Educational Psychology 

Journal of Educational Sociology 

Journal of Psychology 

Journal of Social Psychology 

Research Quarterly of the American Association for Health, Physical 
Education and. Recreation 

Bulletin of the National Association of Secondary School Principals 

Educational Administration and. Supervision 

Journal of Negro Education. > 9 

Educational Research Bulletin (Ohio State University) 

National Business Education Quarterly 

State Teachers Association Research Reports 

State Department of Public Instruction Research Reports 


Quarterlies, reports, and yearbooks of national associations are 
an important part of the literature of education. Many of these 
publications are devoted to a single topic. A recent issue usually 
lists the topics covered in previous issues. 


Graduate students should investigate the publications of these 
professional societies and associations: 


American Association for Health, Physical Education and Recreation 
American Association of Colleges for Teacher Education | 
American Association of School Administrators 

American Council on Education 

Association for Supervision and Curriculum Development 

Association for Higher Education | 
Association for Student Teaching 

' Department of Rural Education of the NEA 

Educational Policies Commission 
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Elementary School Principals 

Fund for the Advancement of Education (Ford Foundation) 
National Art Education Association 

National Association of Secondary School Principals 

National Council on Teacher Education and Professional Standards 
National Council for the Social Studies 

National Council of Teachers of Mathematics 

National Society for the Study of Education 

Speech Association of America 

World Confederation of Organizations of the Teaching Profession 
State Departments of Public Instruction 

State Teachers Associations 


NOTE-TAKING 


One of the most important research activities of the graduate 
student is note-taking, putting materials in a form that can be easily 
recalled and used in the future. Notes will result from speeches and 
lectures, class discussions, conversation, from solitary meditation, 
and from reading reference materials. In preparing term papers 
and research reports the notes that result from reading will be most 
significant. Without a careful, systematic system of note-taking, 
riuch of what is read is quickly forgotten. ] 

Reading-reference notes have been classified under four prin- 
cipal categories: 

l. Quotation. The exact words of an author 
enclosed in quotation marks. It is essential to copy each statement 
accurately, and to indicate the exact page reference so that the 

" quotation may be properly footnoted in the written xin d 

2. Paraphrase. The reader restates the author's thoughts 1 


are reproduced, 


Own words 
. 4 contents 
3. Summary. The reader states in condensed form the 
Of the arti indicati 
article. own reaction, indicating 


The reader records his 


4. Evaluation. 
terpre 


n 5 i oint of view of 
his agreement or disagreement, or 1 ting the por 
the wri t 

En these types, when it 


5 ; al of 
A single note card may include several 


s 3 
ems appropriate. 
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A suggested method for taking notes 


l]. Skim the reference source before copying any notes. A 
bird's-eye view is essential before one can make a decision on what 
material to record and use. Selecting the most significant material 
is an art to be cultivated. 

2, Use 4" x 6" index cards. They are easily sorted by subject 
headings, and are large enough to include a reasonable amount of 
material. Some students prefer S" x 8” cards, which are less con- 
venient to carry but provide more space for notes. 

3. File each note card under a definite topic or heading. Place 
the subject heading at the top of the card for convenient filing. A 
complete bibliographic citation should be placed at the bottom 
of the note card. If a book has been used, the call number should 
be indicated to facilitate library location in the future. 

4, Include only one topic on a card. This makes organization 
of notes flexible. If the notes are lengthy, use consecutively num- 
bered cards, and slip a rubber band around them before filing. 

5, Be sure that notes are complete and clearly understandable, 


Needs for Happiness and Adjustment 


All people have these fundamental needs: 


Belongingness--to be accepted as part of the 
group. 

Participation--to contribute to the group; to 

take an active part; to play on the team. 
Status--to be recognized as somebody; to achieve. 
Secur: --to feel that one has a good chance of 
keeping belongingness, participation, and status-- 
at least a chance to calculate the risks. 


Krug, Edward. Curriculum Planning. New York: 


Harper 
& Brothers, 1950. pp. 34-5 


Fig. 3-3 Note card. 
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for they are not likely to be used for some time after they have 
been copied. 

6. Distinguish clearly between a summary, a direct quotation 
of the author, a reference to the author's source, and an evaluative 
statement. 

7. Don't plan to recopy or type your notes. It wastes time and 
increases possibility of error and confusion. Copy your notes care- 
fully the first time. 

8. Keep a supply of note cards with you at all times, so that you 
can jot down ideas that come to you while waiting, riding the bus, 
or listening to a lecture or discussion. 

9. Be careful not to lose your notes. As soon as they are copied, 
file them in a card index box. If you must carry them with you, use 
the 4" x 6" or 5" x 8" accordion file folder, and be sure that your 
name and address is clearly printed on it. 

10. Keep a permanent file of your notes. You may find the same 
notes useful in a number of courses or in writing a number of re- 


ports. 


THE BIBLIOGRAPHY 


In preparing a formal report or paper, it is customary to include 
a bibliography, indicating the references that have been used in 
preparing the report. Writing a brief descriptive comment or 
annotation adds to the usefulness of the entries. 

The most convenient way to assemble and organize the bibliog- 
raphy is by the use of 3" x 5" bibliography cards. The card includes 
the call number (if the reference is a book), the name of the author, 
the facts of publication, and the annotation. Placing the informa- 
tion on cards makes it easy to assemble the author's names in the 
alphabetical order in which they are listed in the bibliography of 


the report. F 


Compiling a bibliography 
ching for references 


Students often waste a great deal of time sear: 
Actually, on almost 


on a particular topic in an unsystematic way. 
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370.07 Corey, Stephen, Action Research to 
Improve School Practices. New York: 
Bureau of Publications, Teachers 
College, .Columbia University, 1953. 
161 pp. 


Purposes and procedures involved in action re- 
search are thoroughly explained. An excellent 
bibliography is included. 


Fig. 3-4. Bibliography Card. 


any topic there are many ready-made bibliographies that may be 
used in getting started. . 

The search for bibliographies is an ever-expanding process, for 
each reference leads to a new list of sources. While the order sug- 
gested below does not exhaust the process of compiling a bibliog- 
raphy, it does provide a systematic plan for getting underway. 
Start looking for references in the following order: 


1. 


OU um C5 to 


Recently published textbooks that specifically deal with your 
topic, or general textbooks that have sections or chapters de- 
voted to the topic. 


. The library card catalogue. 

. The Education Index. 

. The Encyclopedia of Educational Research. 

. The Review of Educational Research (find the recent issues 


devoted to your problem area). 


. The Bibliographic Index. 
- Other specialized indexes and encyclopedias. 
. Yearbooks of professional societies or associations. 
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9. School Review or Elementary School Journal. 
10. The Cumulative Book Index. 


SUMMARY 


Practically all that man knows can be found in books and in 
libraries. Both the professional worker in education and the gradu- 
ate student, as consumers if not producers of research, should be 
familiar with the library and its many facilities and services. They 
should know about the most important reference sources in educa- 
tion and its related fields. 

An extensive list of references has been presented, including many 
more than a student should be expected to remember. Those con- 
sidered basic have been designated by an asterisk.(°) The course 
instructor may wish to indicate others. It is hoped that this chapter 
will serve as a useful ready reference when a particular need arises. 

Skill in compiling a bibliography, and skill in taking, recording, 
and filing notes is essential for graduate students. The brief sug- 
gestions provided should be helpful to both students and profes- 


Sional workers in education. 


BIBLIOGRAPHY 


ry Cataloging. Chicago: Ameri- 


; imple Libra: 
piers Susan G 250 pp. An excellent basic refer- 


can Library Association, 1954. 
ence on book classification. ; 
American Association for Health, Physical Education and Recrea- 
tion, Research Methods Applied to Health, Phistod EN SAG 
and Recreation. Washington: The Association, 1949. 939 pp. 
Read pp. 84-124. 
Barzun eee and Henry F. Graff, The Modem eae 
New York: Harcourt, Brace and Co., Inc., 1957. pp: 
Chap. IV. 
Brickman, William, "Educational Refer 
Society, 79:166-72, May 29, 194 dni 
Herdman Margaret M., Classification, Ae AU Tick ds 
Chicago: American Library Association, . 


ence Works,” School and 
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a history of book classification and a description of various sys- 
tems. 

Lawler, John, The H. W. Wilson Company. Minneapolis: Univer- 
sity of Minnesota Press, 1950. 207 pp. A history of the pub- 
lishing activities of the Wilson Company, and an account of its 
many library services. 

Wiles, Kimball, “Are We Developing Skill in Fact Collecting?” 
Journal of Educational Reesarch, 38:617-623, April, 1945. Com- 
mon errors in library procedures are described. 


4 


HISTORICAL RESEARCH 


pe 


\HISTORY IS A COMPLETE, ACCURATE, AND MEANING- 
ful record of man’s achievement. It is not merely a list of chrono- 
logical events, but a truthful, integrated account in which persons 
and events are examined in relation to a particular time and place. 


Man uses history to understand the present in light of past events 
It enables him to predict with some degree of 


and developments. 
he future and, on the basis 


assurance what is likely to happen in t 
85 
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of that knowledge, to choose alternatives that will lead to more 
favorable decisions or courses of action. 

The focus of history may be directed towards an individual, a 
group, an idea, a movement, or an institution. However, no one 
of these objects of historical observation can be considered in isola- 
tion. No man can be subjected to historical investigation without 
some consideration of his contribution to the ideas, movements, or 
institutions of a particular time or place. These elements are 
always interrelated. The focus merely determines the point of 
emphasis towards which the historical observer directs his attention. 

Table 4-1 illustrates several of these interrelationships, taken 
from the history of education. For example, no matter whether 
the historian chooses for study the Jesuit Order, religious teaching 
orders, the Counter-Reformation, or Ignatius of Loyola, each of 


the other elements appears as a prominent influence or result, and 
as an indispensable part of the narrative. 


WHAT. IS HISTORICAL RESEARCH? 


Historical research is the application of the scientific method o^ 
inquiry to historical problems. It demands standards of careful 
methodology and spirit comparable to those which characterize 
other types of research. Historical research involves identification 
and limitation of the problem; formulation of the hypothesis; collec- 
tion, organization, verification, validation, and analysis of data; 
testing the hypothesis; and writing of the historical account. All 
of these steps lead to new understanding of the past and its 
relevance to the present and the future. 

A knowledge of the findings of historical research is important 
to the professional worker in education. These studies provide 
important information concerning the effects of certain past educa- 
tional practices, and. may suggest programs for future action, based 
upon the evaluation of these past experiences. They also offer an 
explanation of the how and why of many of the theories and prac- 
tices thac have developed and that now prevail in the schools. They 
help educational workers to identify and evaluate fads and band- 
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wagon schemes that have appeared on the educational scene before. 
They also contribute to an understanding of the significance of edu- 
cation and the interrelationship between the school and the society 
from which the school derives its functions. 

The process of historical research presents some problems that 
make it a somewhat distinctive and difficult task. The selection 
of an appropriate problem is hazardous. The problem must be 
sufficiently delimited so that a satisfactory analysis is possible. 
Too often, beginners state the problem much too broadly. The ex- 
perienced historian realizes that research must be a penetrating 

- analysis of a limited problem, rather than the superficial examination 
of a broad area. The weapon of research is the rifle, not the shot- 
gun. : 

_A carefully formulated hypothesis is also necessary, for it gives 
direction or focus to the gathering and analysis of data. Without 
a clear hypothesis, historical data-gathering becomes a purposeless 
grubbing for facts, rarely leading to new truths for more adequate 
interpretation of the present and preciction of the future. 

The gathering and analysis of data presents particular difficulties: 
to the historian. Since he has not lived at the time, and is thus 
removed from the events that he investigates, he must draw his data 

. from the experiences and observations of others. 


Occasionally, he 
may view relics or remains from the past. 


But in his interpreta- 
tion he must depend upon inference and logical analysis, rather than 
upon direct experience.) In order to have information that is trust- 
worthy, he must rely on primary or first-hand accounts. í This stage 
of the historical research process calls for a high degree of imagina- 
tion, ingenuity, and resourcefulness. These qualities are the prod- 


ucts of scholarship’and long devotion to the method of historical 
analysis. | 


SOURCES OF DATA 


\ Historical sources of data are usually classified into two main 
categories: primary sources, which are fundamental to historical 
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research; and secondary sources, which may sometimes be used in 
the absence of primary data. 


Primary sources of data 


Primary sources consist of: 

a) Remains or relics associated with a person, group, or period. 
Fossils, skeletons, tools, weapons, food, utensils, clothing, buildings, 
furniture, pictures, paintings, coins, and art objects are examples of 
those unconscious remains that were not deliberately intended for 
use in transmitting information or as records. However, these 
sources may provide clear evidence about the past. The contents 
of an ancient burial place, for instance, may reveal a great deal 
of information about the way of life of a people—food, clothing, 
tools, weapons, art, religious beliefs, means of livelihood, and cus- 
toms. 

b) Oral or written testimony, or the records kept and written 
by actual participants in, or witnesses of, an event. These sources 
are consciously produced for the purpose of transmitting informa- 
tion to be used in the future. Documents classified as primary 
sources are constitutions, charters, laws, court decisions, official 
minutes or records, autobiographies, letters, diaries, genealogies, 
contracts, deeds, wills, permits, licenses, affidavits, depositions, - 
declarations, proclamations, certificates, lists, handbills, bills, re- 
ceipts, newspaper and magazine accounts, advertisements, maps, 
diagrams, books, pamphlets, catalogues, films, pictures, paintings, 
inscriptions, recordings, transcriptions, and research reports. 


Secondary sources of data 


f Secondary sources are the reports of a person who relates the 
testimony of an actual witness of, or participant in, an event. The 
writer of the secondary source was not on the scene of the event. 
He merely reports what the person who was there said or wrote. 
Secondary sources of data are usually of limited worth because of 


the usual errors that result when information is passed on from 
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one person to another. Most history textbooks and encyclopedias 
are examples of secondary sources, for they are often several times 
removed from the original, first-hand account of events. 

Some types of material may be secondary sources for some pur- 
poses and primary sources for another. For example, a high school 
textbook in American history is ordinarily a secondary source. But 
if one were making a study of the changing emphasis on nationalism 
in high school American history textbooks, the book would be a 
primary document or source of data. 


HISTORICAL CRITICISM 


It has been noted that the historian does not often use the method 
of direct observation. Past events cannot be repeated at will. 
Since he must get much of his data from the reports of those who 
witnessed or participated in these events, the data must be subjected 
to careful analysis to sift the true from the irrelevant, false, or mis- 
leading. o 

Trustworthy, usable data in historical research are known as his- 
torical evidence. It is that body of validated facts and information 
that can be accepted as trustworthy, as a valid basis for the testing 
and interpretation of the hypothesis. Historical evidence is derived 


from historical data by the process of criticism, and is of two types: 
external criticism and internal criticism. 


External criticism 


External criticism establishes the authenticity or genuineness of 
data. Is the remain or document a true one rather than a forgery, 
a counterfeit, or a hoax? Various tests of genuineness may be 
employed. 

The problem of establishing age or authorship of documents may 
involve many intricate tests of signature, handwriting, script, type, 
spelling, language usage, documentation, knowledge available at the 
time, and consistency with what is known. It may involve physical 
and chemical tests of ink, paint, paper, parchment, cloth, stone, 


ay 


=, 
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metals, or wood. Are these elements consistent with known facts 
about the person, the knowledge available, and the technology of 
the period in which the remain or the document originated? 


Internal criticism 


After the authenticity or genuineness of a historical document 
or relic has been established, there is still the problem of evaluat- 
ing its accuracy or worth. While it may be genuine, does it reveal 
a true picture? What of the writer or creator? Was he competent, 
honest, unbiased, and actually acquainted with the facts, or was 
he too antagoriistic or too sympathetic to give a true picture? Did 
he have any motives for distorting the account? Was he subject to 
pressure, fear, or vanity? How long after the event did he make a 
record of his testimony, and was he able to remember accurately 
what happened? Is the witness in agreement with other com- 
petent witnesses? 

These questions. are often difficult to answer, but the historian 
must be sure that his data are authentic and accurate. Only then 

“may he introduce them as historical evidence, worthy of serious 
consideration. The following examples illustrate how the processes 
of historical criticism were used to expose a hoax and to establish the 


authenticity of an important historical discovery. 


The Cardiff Giant 


An amazing series of events concerning the authenticity of a his- 
torical remain is related in "The Real Story of the Cardiff Giant," 
by Alan Hynd. The Cardiff Giant was a ten-foot, four-and-one- 
half-inch figure of a man, weighing about 3,000 pounds, found in 
1869, buried three feet beneath the surface of a farmer's field, near 
Cardiff, New York, about thirteen miles south of Syracuse. 

The huge figure was examined by two scientists from Yale Uni- 


in True, “The Man's Magazine," later anthologized 
Alexander Klein (Philadelphia: J. B. Lippincott Co., 
d here by permission of Fawcett Publications. 


1 Originally published 
in Grand Deception, ed. 
1955), pp. 126-185. Use 
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versity, who pronounced it a fossilized human figure. A delega- 
tion of archeologists from the New York State Museum were of 
the opinion that the figure was an ancient statue. Ralph Waldo 
Emerson called it a bona fide petrified human being, while Dr. 
Oliver Wendell Holmes, the celebrated Harvard anatomist and 
father of the-great jurist, declared that it was a statue of great 
antiquity. Scores of clergymen who came to see it enthusiastically 
claimed that the figure was a fossilized man of Biblical times, prov- 
ing the story of Genesis to be literally true. 

The local owners turned down an offer by P. T. Barnum to buy 
the figure, whereupon Barnum commissioned a sculptor to make an 
exact replica of the Giant, which he later exhibited in his museum 
on Broadway in New York City, advertising it as the one, the only, 
the original Cardiff Giant. When the Cardiff owners sought an 
injunction against Barnum, the judge denied it, saying that the 
original was only a fake. 

An unknown newspaper reporter, prompted by the growing feel- 
ing that the giant was a hoax, traced the shipinent of a huge box 
labeled machinery to the farm near Cardiff, nearly a year before: 
the Giant’s discovery. Carefully tracing back detail upon detail, 
he discovered that a Mr. Hull had acquired a huge block of gypsum 
at Ft. Dodge, Iowa, and had shipped a box labeled machinery, 
weighing exactly what the block of gypsum had weighed, to Chi- 
cago. From hotel, railroad, and drayage company records, he 
traced the shipment to a barn in the 900 block of North Clark Street 
in Chicago, The owner of the barn confessed his part in the scheme 
and implicated Hull, a stonecutter, and an artist who had fashioned 
the figure. X 

It was revealed that Hull, while visiting his sister in Ft. Dodge, 
Iowa, had gone to hear an evangelist who, while preaching about 
the sixth chapter of Genesis, had described in some detail and with 
much enthusiasm the “giants in the earth” mentioned there. Seeing 
a chance to make some easy money, Hull planned to have one of 
these giants fabricated, aged with sulphuric acid, secretly planted in 
the ground on his cousins New York farm, and accidentally discov- 
ered by some well-diggers, ostensibly hired to dig a new well. 

The rest was easy. Hull made no claims. The clergymen and 


— M — 
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the experts made the claims for him, and the controversy between 
them only added to the fame (and money-drawing power) of his 
stone figure. 

While this story does not actually illustrate scholarly research, the 
activities of the reporter represent a simple example of external 
criticism, for by following his hunch or hypothesis that the figure 
was recently man-made, and not an ancient statue or a fossilized 
man, he tracked down and exposed the facts. This is quite remark- 
able in the light of the fact that prominent archeologists, anato- 
mists, and scholars had been completely fooled by the hoax. 

The following example describes historical criticism of a more 
scholarly type, "carried on by scientists and Biblical scholars, in 
which historic documents were proven to be genuine. 


The Dead Sea Scrolls 


One of the most interesting and most significant historical dis- 
coveries of the past few decades was the finding of the Dead Sea 
Scrolls. This collection of ancient manuscripts was discovered in 
1947 by a group of Bedouins of the Ta'amere tribe. Five leather 
scrolls were found, sealed in tall earthenware jars in the Qumran 
caves near Aim Feshkha, on the northwest shore of the Dead Sea? 

The Bedouins took the scrolls to Metropolitan Mar Athanesius 
Yeshue Samuel, of St. Mark's monastery in Jerusalem, who pur- 
chased them after discovering that they were written in ancient 
Hebrew. A consultation with Biblical scholars confirmed the fact 
that they were very old and possibly valuable. They were later 
purchased by Professor Sukenik, an archeologist of Hebrew Univer- 
sity at Jerusalem, who began to translate them. „ He also had por- 
tions of the scrolls photographed to send to other Biblical scholars 
for evaluation. Upon examining some of the photographs, Dr. 
William F. Albright of Johns Hopkins University pronounced them 
“the greatest manuscript discovery of modern times." * 


2 A. Powell Davies, The Meaning of the Dead Sea Scrolls (New York: New 
American Library of World Literature, Inc., 1956), p. 9. Used with permissicn 


of the publisher. 
3 Edmund Wilson, The Scrolls From the 


versity Press, 1955), P. 18, Used with permissi 


Dead Sea (New York: Oxford Uni- 
on of the author. 
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A systematic search of the Wadi Qumran area caves in 1952 
yielded other leather scrolls, many manuscript fragments, and two 
additional scrolls of copper, so completely oxidized that they 
could not be unrolled without being destroyed. By 1956, scien- 
tists at the University of Manchester, England, had devised a 
method of passing a spindle through the scrolls, spraying them with 
aircraft glue, baking them, and then sawing them across their rolled- 
up length to yield strips which could be photographed. 

There has been much controversy about the scrolls as to their 
origin, their age; and their historic value. By careful and sys- 
tematic external and internal criticism, certain facts have been 
established and quite generally accepted by Biblizal scholars and 
scientists. 

The scrolls are very old, probably dating back to the first century 
A.D. They are written in ancient Hebrew, and probably originated 
in a pre-Christian monastery of one of the Jewish sects. The writ- 
ings contain two versions (one complete and one incomplete) of 
the Book of Isaiah, a commentary or Midrash on the Book of 
Habakkuk, a set of rules of the ancient Jewish monastery, a collec- 
tion of about twenty Psalms similar to those of the Old Testament, 
and several scrolls of apocalyptic writings, similar to the Book of 
Revelations.5 

The contents of the copper scrolls and other fragments are in the 
process of translation. It is possible that more scrolls and writings 
may be discovered in the area, and it is likely that these ancient 
documents may throw new light on the Bible and the origins of 
Christianity. 


It is interesting to note how these documents were authenticated, 
dated, and evaluated: 


1. By an analysis of the Hebrew alphabet forms used. 

2. By a radio-carbon test of the age of the linen scroll coverings, con- 
ducted by the 7nstitute of Nuclear Research at the University of 
Chicago. 

3. By careful examination of the pottery form in which the scrolls 
were sealed. 

* Davies, op. cit., p. 18. 

5 Davies, op. cit., p. 19. 
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4, By examination of coins found in the caves with the scrolls. 

5. By a translation of the scrolls that was compared to other writings, 

both Biblical and non-Biblical, of known antiquity. 

While external criticism has now produced convincing evidence 
of the genuineness and age of the documents, internal criticism of 
their validity and relevance will be pursued by Biblical scholars for 
many years to come, and may provide many new hypotheses con- 
cerning Biblical writings and the early history of Christianity and 


the pre-Christian Jewish sects. 


Synthesis 


After the data:have been gathered and subjected to external criti- 
cism for genuineness, and to internal criticism for trustworthiness, 
the problem of synthesis remains. The historian must piece to- 
gether into a meaningful pattern the evidence that has been 
gathered, and then apply it to the testing of the hypothesis. This 
of historical research calls for a great deal of imagination 


phase 
urcefulness, as well as careful adherence to the method of 


and resour: 
logical thinking. 


Writing the report 


No less challenging is the writing of the report, which calls for 
creativity in addition to the qualities previously mentioned. Re- 
search reports should be written in a style that is dignified and 
objective. However, the historian is permitted a little more free: 
dom in reporting. Homer Carey Hockett suggests that “the his- 
torian is not condemned to a bald, plain, unattractive style,” and 
that “for the sake of relieving the monotony of statement after 
statement of bare facts, it is permissible, now and then, to indulge 


He concludes, however, by warning that “above 


in a bit of color.” 
zim, or be allowed to 


all, embellishments must never become a first 
hide or distort the truth." $ 


ntroduction to Research in American History (New 


6 Homer C. Hockett, I 
p. 139. Used with permission of the pub- 


York: The Macmillan Co., 1948), 
lisher. 
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An evaluation of graduate students’ historical-research projects 
generally reveals one or more of these faults: 


1. Problem too broadly stated. 

2. Tendency to use easy-to-find secondary sources of data, rather than 
sufficient primary sources, which are harder to locate but usually 
more trustworthy. 

3, Inadequate historical criticism of data, due to failure to establish 
authenticity of sources and trustworthiness of data. For example, 
there is often a tendency to accept a statement as necessarily true 
when several observers agree. It is possible that one may have 
influenced the other, or that both were influenced by the same 
inaccurate source of information. 

4. Poor logical analysis resulting from: 

a) Oversimplification—failure to recognize the fact that causes 
of events are more often multiple and complex than single 
and simple. 

b) Overgeneralization on the basis of insufficient evidence, and 
false reasoning by analogy, basing conclusions upon super- 
ficial similarities of situations. 

c) Failure to interpret words and expressions in the light of their 
accepted meaning in an earlier period. 

d) Failure to distinguish between significant facts in a situa- 
tion and those that are irrelevant or unimportant. 

5. Expression of personal bias, as revealed by statements lifted out of 
context for purposes of persuasion, assuming too generous or un- 
critical an attitude towards a person or idea (or being too unfriendly 
or critical), excessive admiration for the past (sometimes known 
as the "old oaken bucket" delusion), or an equally unrealistic ad- 
miration for the new or contemporary, assuming that all change 
represents progress, 

6. Poor reporting in a style that is dull and colorless, too flowery or 


flippant, too persuasive or of the "soap-box" type, or lacking in 
proper usage. 


Most of these faults represent a failure to apply the high standards 


of objective, systematic, and logical analysis which characterize true 
historical research. 


SCHOOL LAW RESEARCH 


Research in school law is an application of the methodology of 
historical research. If one has access to a university law school 
library, practically all of the necessary data involved in the research 
are available. However, the interpretation of legal problems in- 
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volves an expertness that few graduate students in ducation pos- 
sess. The ability to find the significant controlling facts in a case, 
and the ability to distinguish the basic principles at issue, are 
competencies that require more than a superficial understanding 
of the law and legal procedures. 

In order to carry on significant research in the area of school law, 
it would be desirable for the student to have had several courses in 
school law, some law school training, and the aid of a school law 
specialist. Most graduate schools have such experts on their 
faculty. 

The law is classified into two main categories: 

1. Statutory law includes provisions written into state and federal 
constitutions, the legislative enactments of state legislatures and 
the Congress, and administrative laws and regulations, having the 
force of law, promulgated by appointed bodies and commissions. 

2. Case or common law includes the principles established by the 
courts in deciding issues not covered by statutory law, but based 
upon sound principles of public policy. It must be remembered 
that laws or regulations are of unknown validity until they have 
been tested in a court of law, and their constitutionality verified by 
the authority of the highest courts of appeal, the supreme courts 
of the various states, or the Supreme Court of the United States. 

M. M. Chambers has presented a list of suggestions on how to 
study and use law decisions.* 


l. Observe what court is being reported and, if the case is on ap- 
peal, from what court or courts it has been appealed. 

2. Observe the form in which the action is brought—whether it is a 
petition for a writ of mandamus, injunction, quo warranto, or 
prohibition; or a suit for pecuniary damages in tort or in contract; 
or an action in equity for the specific performance or reformation 
of a contract or for an accounting of partnership or corporation 
affairs; or a criminal action brought in the name of the state against 
a defendant accused of violation of a penal statute. 

8. Segregate and digest the statement of the facts of the case, before 
trying to understand the application of the law to the facts. 


7 M. M. Chambers, "Legal Research in Education," Review of Educational 
Research, XX1:462—463, December, 1939. Used with permission. 


98 HISTORICAL RESEARCH 


4. 


et 


Determine what is the precise question of law which the court 
is called upon to decide. The courts’ answer to this precise point 
is the decision of the case. 

Note whether the decision seems to be in harmony with any 
broadly accepted rule of law. (Often the court will state the 
broad rule.) 


- Note whether the judge indulges in any discussion of points on 


which the court is not called upon to decide. Judicial pro- 
nouncements not directly related to the ratio dicidendi, or determi- 
nation of the legal issue in the case, are called dicta, and rank 
much lower than a decision in point of weight as precedents. 
Nevertheless, a mere dictum often is a figurative bomb packed full 


of brilliant philosophy which will illuminate its area of the law for 
years to come. 


. In view of the fact that all courts of last resort and most appellate 


courts are collegial—that is, consisting of several judges sitting 
en banc—note whether the decision and the opinion are concurred 
in by all the judges sitting, or whether one or more judges have 
filed specially concurring opinions or dissenting opinions. These 
may be important for the sake of the social philosophy they ex- 
press. A large proportian of the essential wisdom to be extracted 
from the records of the United States Supfeme Court for a gen- 
eration past is to be found in the long line of brilliant dissenting 
opinions by the late Justice Oliver Wendell Holmes. These opin- 
ions were frequently concurred in by Justice Brandeis, later by 
Justices Stone, Roberts and Chief Justice Hughes, finally coming 


to represent the social philosophy of a majority of the court in 
many particulars. 


- Try to orient the case in your own social and legal philosophy; 


evaluate the decision and the opinion critically, sympathetically, 
tolerantly; struggle to interpret it and express it vividly and mean- 
ingfully; make it live in the mind of your reader. 

Get the complete caption and citation, including date. 


. Jot down the supporting authorities cited in the course of the 


opinion and follow them up, thus developing the history of the 
principles of law involved.and disclosing trends. 


e 


A comprehensive and annotated list of school law references is 
included in Chapter 3. The beginner is advised to refer to some of 
the basic textbooks in school law, such as Edwards, Hamilton and 


Mort, 


or Remmlein, and to consult a dictionary of legal terms, be- 


—— 
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fore attempting to interpret the court decisions thay make up the 
primary sources of school law (see Chapter 3). 


SUMMARY 


History, the complete, accurate, and meaningful record of man's 
achievement, helps him to understand the present and to predict 
somewhat the future. Historical research is the application of the 
scientific method to the description and analysis of past events. 

The historian ordinarily draws his data from the observations and 
experiences of others. Since he is not likely to have been at the 
scene of the event, he must use logical inferences to supplement 
what is probably an incomplete account. 

Primary sources may be "unconscious" testimony, not intended 
to be left as a record—relics or remains such as bones, fossils, cloth- 
ing, food, utensils, weapons, coins, and art objects are useful. 
Conscious testimony, in the form of records or documents, is an- 
other primary source of information—^xamples are Constitutions, 
laws, court decisions, official minutes, autobiographies, letters, con- 
tracts, wills, certificates, newspaper and magazine accounts, films, 
recordings, and research reports. 

Historical criticism is the evaluation of primary data. 
criticism is concerned with the authenticity or genuineness of re- 
mains or documents. Internal criticism is concerned with the trust- 
worthiness or relevance of materials. The story of the Cardiff 
Giant and the account of the Dead Sea Scrolls illustrate the proc- 
esses of historical criticism. 

The historical research studies of graduate students often reveal 
serious limitations. Frequently encountered are such faults as stat- 
ing the problem too broadly, inadequate primary sources of data, 
unskillful historical criticism, poor logical analysis of data, personal 
bias, and ineffective reporting. > 

Research in school law is usually considered a phase of historical 
research, with statutes and court decisions providing the primary 
sources of data. This field of inquiry is not an appropriate one for 
the inexperienced student of law, for it requires an expertness that 


External 
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few graduate students possess. Some specialized law training, sev- 
eral courses in school law, and the counsel of a law expert are 
desirable, if not necessary, qualifications. 
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DESCRIPTIVE RESEARCH 


DESCRIPTIVE RESEARCH DESCRIBES AND INTERPRETS 
what is. It is concerned with conditions or relationships that 
exist; practices that-prevail; beliefs, points of view, or attitudes that 
are held; processes that are going on; effects that ar 
or trends that are developing. 

‘The ‘process of descriptive research 
and tabulation of data. It involves 


102 


e being felt; 


goes beyond mere gathering 
an element of interpretation 
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of the meaning or significance of what is described. {Thus, descrip- 
tion is often combined with comparison or contrast, i1volving meas- 
urement, classification, interpretation, and evaluation. 

Unfortunately, there has been little agreement on the meaning 
of many of the terms used in the field of social research. Some 
authors have called this type of analysis descriptive research. Since 
all types of research involve an element of description, however, this 
term is not entirely satisfactory. Others have used the term survey 
research, but this term is frequently used in referring to a particular 
type of descriptive study. ` Since there is no general agreement, the 
selection of a term must be somewhat arbitrary, with the realiza- 
tion that any label that is selected may be criticized on the basis of 
logic or usage, 

The author has selected the term descriptive research, trusting 
that the treatment of.this chapter will be reasonably logical and 
consistent. Important as terminology is, the more important task 
is to develop an understanding of the nature of this broad classifi- 
cation of methodology, to appreciate its value in helping to solve 
educational problem$, and to acquire some skill in applying its vari- 
vus techniques for problem-solving. 

At the outset; it must be emphasized that merely describing what 
is does not comprise the entire research process. Although the 
gathering of data and the description of prevailing conditions or 
practices are necessary steps, the research process is not completed 


until the data are organized and analyzed, and significant conclu- ` 


sions are derived. These conclusions will be based upon com- 
parisons, contrasts, or relationships of one kind or another. Thus, 
the discovery of meaning is the focus of the whole process. y 

^ While some experimental studies of human behavior can be ap- 
propriately carried on, both in the laboratory and in the field, the pre- 
vailing method of the social sciences is descriptive.) Under the 
conditions that naturally occur in the home; the classroom, the 
recreation center, the factory, or the community, human behavior 
can be systematically examined and analyzed. This analysis may 
lead to the modification of factors or influences that determine the 
nature of human interaction. It is through this modification of fac- 
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tors that soci institutions may become more effective influences in 
the promotion! of human welfare. 


DESCRIPTIVE RESEARCH IN PROBLEM-SOLVING 


In solving a problem or charting a course of action several sorts 
of information may be needed. These data may be gathered 
through the processes of the descriptive method. 

The first type of information is based upon present conditions. 
Where are we now? From what point do we'start? These data 
may be gathered by a systematic description and analysis of all the 
important aspects of the present situation, 

The second type of information involves what we may want. 
In what direction may we go? What conditions are desirable or 
are considered to represent best practice? This clarification of 
objectives or goals may come from a study of what we think we 
want, possibly resulting from a study of conditions existing else- 
where, or what experts consider to be adequate or desirable, 

The third type of information is concerned with how to get there. 
This analysis may involve finding out about the experience of others 
who have been involved in similar situations. It may involve the 
opinions of experts, who presumably know best how to reach the 
goal ; : 

Some research studies emphasize only one of these aspects of 
problem-solving. Others may deal with two, or even three, of the 
elements. Although a research study does not necessarily embrace 
all of the steps necessary for the solution of a problem, it may make 
a valuable contribution by clarifying but one of the necessary steps 
—from description of present status to the charting of the path to 
the goal. $ 
|, Descriptive research may supply some, or all, of the needed in- 
formation» An example may serve to illustrate how descriptive 
studies can be used to help solve an educational problem. 

Washington Township has a school building problem. 


Its pres- 
ent educational facilities seem inadequate, and 


if present develop- 
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ments continue, conditions may be much worse in thy future. The 
patrons and educational leaders in the community know that a 
problem exists, but they realize that this vague awareness does not 
provide a sound basis for action. 

The first step involves a systematic analysis of present conditions. 
How many school-age children are there in the township? How 
many children are of preschool age? Where do they live? How 
many classrooms now exist? How adequate are they? What is 
the average class size? How are these present buildings located in 
terms of residential housing? How adequate are the facilities for 
food, library, health, and recreational services? What is the present 
annual budget? How is it related to the tax rate and the ability 
of the community to provide adequate educational facilities? 

The second step projects goals for the future. What will the 
school population be in five, ten, or twenty years? Where will 
the children live? How many buildings and classrooms will be 
needed? What provisions should be made for special school serv- 
ices, for libraries, cafeterias, gymnasiums, and play areas to take 
care of expected educational demands? 

Step three considers how to reach those goals, established by the 
analysis of Step two. What kind of buildings should be provided? 
Should schools be designed for grades one through eight, or should 
six-year elementary schools and separate three-year junior high 
schools be provided? How will the money be raised? When and 
how much should the tax rate be increased? When should the 
building program get under way? 

Many of the answers to the questions raised in Steps two and 
three will be arrived_at by analysis of practices of other townships, 
the expressed opinions of school patrons and local educational lead- 
ers, and the opinions of experts in the areas of school buildings, 
school organization, community planning, and public finance. Of 
course, this analysis of school building needs is but one phase of the 
larger educational problem of providing an adequate educational 
program for tomorrow’s children. There remain problems of cur- 
riculum, pupil transportation, and school personnel. These prob- 
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Jems can also be attacked by using similar methods of descriptive re- 
search. \ 


\ \ TYPES OF DESCRIPTIVE STUDIES 


“In attempting to classify the various types of descriptive studies, 
one again confronts the problem of generally accepted terminology. 
| In the field of social research, two of the terms, survey and case 
study, are used) without the exactness that one might desire. For 
example; the interesting and significant studies made of Muncie, 
Indiana, by Robert and Helen Lynd, published under the titles 
Middletown? and Middletown in Transition? have been classified 
as surveys by some writers and as case studies by others. One 
prominent author refers to them as field studies.5 
The rationale of this presentation is based upon a fairly clear 
distinction which the reader is urged to note carefully. In brief, 
the survey is extensive and cross-sectional, dealing with a rela- 
tively large number of cases at a particular time, and yielding 
statistics that are abstracted from particular cases. The case study 
is intensive and longitudinal, analyzing carefully a single case or a 
limited number of typical cases. (A case may be an individua}, 
a type, a group, or an institution.) The analysis is detailed and 
complete, noting change, growth, or development in the life cycle 
(or an important part of the life cycle) of the case under considera- 
tion. s 
These distinctions are presented as points of reference. In some 
résearch studies one may find characteristics of each approach, mak- 
ing any classification difficult. \Using the rationale presented here, 


1 Robert S. Lynd and Helen M. Lynd, Middletown (New York: Harcourt, 
Brace and Co., Inc., 1929). 

2 Robert S. Lynd and Helen M. Lynd, Middletown in Transition (New York: 
Harcourt, Brace and Co., Inc., 1937). 

8 Marie Jahoda, Morton Deutsch, and Stuart W. Cook, Research Methods in 
Social Relation (New York: Dryden Press, 1951), p. 48. 

* Pauline V. Young, Scientific Social Surveys and Research (Englewood Cliffs, 
N. J.: Prentice-Hall, Inc., 1949), p. 269. 

5 Leon Festinger and Daniel Katz, Research Methods.in Behavioral Sciences 
(New York: Dryden Press, 1953), p. 60. 
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however, the Middletown studies, would be classified as case studies, 
for they intensively analyze the life of a typical corimunity (case), 
tracing growth and change over a period of time. y4 

/ 


THE SURVEY METHOD 


The survey method gathers data from a relatively large number 
of cases at a particular time; It is not concerned with character- 
istics of individuals as individuals. It is concerned with the gen- 
eralized statistics that result when data are abstracted from a num- 
ber of individual cases. It is essentially cross-sectional. 

Forty million American homes have at least one television set. 
About three oüt of five students who enter the American secondary 
school remain to graduate. Sixty-three per cent of adult Americans 
voted in the 1952 presidential election. The average American 
consumes about ninety-seven pounds of refined sugar annually. 
The ratio of female births to male births in the United States in 

- 1950 was 1910 to 1000. The population of Indiana, according to 
the 1950 census, wes 3,934,294. Dara like these result from many 

, types of surveys. Each statement pictures a prevailing condition at 
a, particular time. 

In analyzing political, social, or economic conditions, one of the 
first steps is to get the facts about the situation—or a picture of con- 
ditions that prevail or that are developing. These data may be 
gathered from surveys of the entire population. Others are inferred 
from a study of.a sample group, carefully selected to be representa- 
tive of the total population. And at times, the survey may describe 
a limited population which is the only group under considera- 
tion. 

The survey is an important type of research. „It must not be con- 
fused with the mere clerical routine of gathering and tabulating fig- 
ures. It involves a clearly defined problem and definite objectives. 
It requires expert and imaginative planning, careful analysis and 
interpretation of the data gathered, and logical and skillful reporting 
of the findings. ` 


a 


| Social surveys | 
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A significant Social survey was made in the late 1930’s under the 
"direction of the Swedish sociologist, Gunnar Myrdal, and spon- 
sored by the Carnegie Foundation, Myrdal and his staff of re. - 
searchers made a comprehensive analysis of the social, political, and 
economic life of the American Negro, Yielding a great mass of data 
on race relations in America.9 

The late Alfred Kinsey of Indiana University made a compre- 
hensive survey of the sexual behavior of the human male,” based 


on data gathered from over 12,000 cases. His second study of the 
behavior of the human female 8 


While these studies have raised co 


Witty ® has studied the television-viewing habits of school chil- 


orts on his investigations since 
1950. These studies were conducted in the Chicago area, and indi- 


their teachers, An effort was ma 


intelligence, reading habits, academic achievement, and other fac- 
tors, 


Shaw and McKay 1° have made a study of juvenile delinquency in 
Chicago yielding significant data on the nature and extent of delin- 
quency in large urban communities, 


The National Safety Council conducts Surveys on the nature, 


6 Gunnar Myrdal, An American Dilemma: The Negro Problem and Modern 
Democracy (New York: Harper & Brothers, 1944). 

7 Alfred C. Kinsey, et al., The Sexual Behavior of the Human Male (Phil- 
adelphia: W, B. Saunders Co., 1948). 

5 Alfred C. Kinsey, et cl., The Sexual Behavior of the Human F, emale ( Phil- 
adelphia: W. B. Saunders Co., 1953). 


9 Paul Witty, "Children and T.V.: A Fifth Report;" Elementary English, 
31:349-357, October, 1955. 


10 Clifford R. Shaw and Henry D, McKay, Juvenile Delinquency in Urban 
Areas (Chicago: The University of Chicago Press, 1942). 
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extent, and causes of automobile accidents in all parts of the United 
States. State high school athletic associations conjluct surveys on 
the nature and extent of athletic injuries in membér schools. 


School surveys | 


Many city, township, and county school systems have been 
studied by the survey method for the purpose of determining school 
needs. These surveys are sometimes carried on for a nominal fee 
as a service by the research bureau of a university in the area. 
Frequently, a large part of the data-gathering is done by local edu- 
cators, with the university staff providing direction and advisory 
services. — 

A study of the school system in Wayne Township, Marion County, 
Indiana, illustrates the type of cooperative survey described above." 
Surveys of this type carefully study such items as the nature of the 
community, present plant and equipment, curriculum, staff per- 
sonnel, pupil transportation, school budget, financial resources, and 
other phases of sclsool administration. On the basis of present 
conditions and likely future demands, recommendations are made 
for community action. 

A statewide survey of the public schools of Indiana !? was con- 
ducted in 1947 by the Indiana School Study Commission, an agency 
created for the purposes of the survey. ) Directed by a fifty-seven 
member committee of laymen and professional educators, a thor- 
ough study was made of all aspects of public education in Indiana. 
Hundreds of administrators, classroom teachers, and college people 
participated in the study, aided by seven out-of-state specialists who 
guided various phases of the survey. Recommendations for action 
were made on the basis of the findings, providirfg a sound basis for 
planning the future of public education in the state, 


11 School of Education, Indiana University, A Cooperative Study of the 
Public School Enrollment and the School Building and Financial Needs of 
Wayne Township, Marion County, Indiana (Bloomington, Ind.: Division of 
Research and Field Services, Indiana University, 1955). 

12 An Evaluation of the Indiana Public Schools (Indianapolis: Indiana School 
Study Commission, 1949), 418 pp. 
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A helpful guide providing directions for conducting school surveys 
has been publithed by the Department of Public Instruction of the 
State of Indianas 


Public-opinion surveys 


In our culture, where so many opinions on controversial subjects 
are expressed by well-organized special-interest groups, it is im- 
portant to find out what the people think. Without a means of poll- 
ing public opinion, the views of only the highly organized minorities 
are effectively presented through the printed page, radio, and tele- 
Vision. 

How do people feel about the admission of Red China to 
the United Nations, the foreign aid program, racial integration in the 
public schools, compulsory military training, the adequacy of the 
public schools, and federal aid to education? What candidate do 
they intend to vote for in the next election? Such questions can be 
partially answered by means of the public-opinion survey. Many 
research agencies carry on these surveys andcreport their findings 
in magazines and in syndicated articles in daily newspapers. 

Since it would be impracticable or even impossible to get an ex- 
pression of opinion from every person, sampling techniques are em- 
ployed in such a way that the resulting opinions of a limited number 
of people can be assumed to be representative or typical of the 
reactions of the entire population. 

The names Gallup, Roper, and Crossley are familiar to newspaper 
readers as names associated with public-opinion surveys. These 
surveys of opinion are frequently analyzed and reported by such 
classifications as age groups, sex, educational level, occupation, 
income level, political affiliation, or area of residence. Researchers 
are aware of the existence of many publics, or segments of the 
public, who may hold conflicting points of view. This further anal- 
ysis of opinion by subgroups adds meaning to the analysis of public 
opinion in general, 

13 How to Study School Building Needs: A Workbook 


Survey Committees (Indianapolis: Department of Public In 
indiana, 1953), 163 pp. 


for Local School 
struction, State of 
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In evaluating public-opinion analysis several possible sources of 
error may be recognized. The problem of accurate sampling is an 
important element. The failure of the 1936 Literary Digest Poll 
to accurately forecast the results of the Landon-Rcosevelt campaign 
has been attributed to a bias in sampling. The survey chose its 
respondents from automobile registrations lists and from telephone 
directories. During the depression period, large numbers of voters 
neither owned cars nor were telephone subscribers, and conse- 
quently were not represented in the sample. 

In the 1948 election campaign a prominent poll predicted the 
election of Governor Thomas E. Dewey over President Harry S: 
Truman. Again the pollsters were wrong, possibly this time be- 
cause they failed to recognize the shifting nature of public senti- 
ment. Had the survey been made just prior to election day, a more 
accurate prediction might have resulted. 

In addition to the limitations suggested, there is the hazard of 
careless responses, given in an off-hand way, that are sometimes at 
variance with the more serious opinions that are expressed aS actual 


decisions. ` 9 E 


Market surveys _, 
PP 


‘Attempts to measure public reaction to consumer products or to 
evaluate the effectiveness of advertising is a specialized application 
of the public-opinion survey. This type of analysis has important : 
implications for designers, manufacturers, distributors, and adver- 
tisers of products in their choice of color, composition, shape, and 
size of the product or the container in which it is packaged and 
displayed. : 

From a carefully selected sample the market researcher attempts 
to discover how the potential customer feels about the product. 
Using questionnaires or interviews, the opinions of the sample group 
are carefully gathered for analysis. Upon the basis of these data 
the producer and advertiser may present the most attractive or ac- 
ceptable product, and predict with some degree of accuracy the 


likelihood of successful marketing. ^, 


J 
/ 
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Manufacturers in the modern competitive market are reluctant 
to risk the millions of dollars necessary to launch a new product 
or a new mode Without some evidence of probable public accept- 
ance, 


MOTIVATION RESEARCH 


Recently a new type of consumer analysis has been developed. 
Known as motivation research, it probes the hidden feelings and 
wishes of consumers. Using the technique of depth interviews, 
Psychologists analyze hidden, unconscious motives of which the 
Consumer himself is unaware. > T 

For example, motivation researchers contend that an automobile 
is much more than a means of transportation: It is an expression 
of what an individual wants to be or what he thinks he is. The 
automobile is an instrument of self-expression. When interviewed 
as to what qualities they wanted in a car, individuals consistently 
ranked in order: economy, appearance, dependability, convenience, 
and safety. When asked what thei: friends considered most im- 


and horsepower. Packard has described the techniques of motiva- 
tion research in The Hidden Persuaders.* This application of the 
descriptive method has become an important element in market 
analysis, product design, and sales Promotion, 


| THE CASE STUDY ) —~ 


When the focus of attention is directed towards a single case or 


[4 
a limited number of cases, the process is Personalized. The case 
study is concerned with everything that is significant in the history 
14 Vanes Packard, The Hidden Persuaders (New York: David McKay Co., 
57). 


t 
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or development of the case. The purpose is to understand the life 
cycle, or an important part of the life cycle, of an individual unit. 
This unit may be a person, a family, a group, a socłal institution, or 
an entire community. The case method probes deeply, and inten- 
sively analyzes interaction between the factors that produce change 
or growth. It emphasizes the longitudinal or genetic approach, 
showing development over a period of time. ) 

Traditionally, in social work or in the field of guidance the term 
case study has assumed a more limited meaning. In this. context 
emphasis is placed upon the study of an individual person, for the 
purpose of diagnosing his problems and recommending remedial 
measures for his rehabilitation. Here the emphasis is not upon the 
individual representing a type, but upon the individual as a unique 
personality, with his own constellation of problems and needs. 
Ordinarily, the social-work or guidance case study is not research- 
oriented, but is directed towards the solution of an individual's 
problems. A study of a number of these individual cases could be 
expanded into a research project, particularly where the typical 
aspects of each vase are contrasted or compared for the purpose 
of arriving at a greater understanding of human behavior, or for 
the purpose of discovering hew generalizations. 

Case studies of the descriptive research type have been made 
of all types of communities} from the hamlet to the great metropolis. 
Case studies have been made of types of individuals—alcoholics, 
drug addicts, juvenile delinquents, migratory agricultural workers, 
share-croppers, industrial workers, members of a profession, execu- 
tives, army wives, trailer court residents, members of a social class, 
Quakers, Amish, Jews, Negroes, American Indians, Chinese-Ameri- 
cans, Puerto Ricans, and many other ethnic or social group) Such 
institutions as colleges, churches, factories, hospitals, corrective 
institutions, welfare agencies, fraternal organizations, and business 
groups have been studied as cases. In each,case the element of 
typicalness is the focus of attention, with emphasis upon the many 
factors that characterize the type. These studies have been con- 
ducted for the purpose of arriving at greater understanding of the 
roles of their subjects in the American pattern of culture. 
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COMMUNITY STUDIES 
\ 7 

_ The community study is a careful description and analysis of a 
group of people living together in a particular geographic location 
in a corporate way. The community study deals with such ele- 
ments of the community as location, appearance, prevailing eco- 
nomic activity, climate and natural resources, historical develop- 
ment, how the people live, the social structure, goals or life values 
and patterns, the individuals or power groups who exert the domi- 
nant influence, the impact of the outside world, and an evaluation 
of the social institutions within the community that meet the basic 
human needs of health and protection, making a living, education, 
religious expression, and recreation. Such studies are case studies, 
with the community serving as the case under investigation. Com- 
munities that are chosen for study usually represent a typical pattern 
of social organization, size, type, or geographic location. 

The community studies made by Robert and Helen Lynd and 
their associates at Muncie, Indiana, are well known. The first, re- 
ported in the volume Middletown ™ in 1929, and the second, Middle- 
town in Transition 1° in 1937, describe the way of life of a typical 
midwestern, average-size city, tracing its development from the gas 
boom of the 1890's through World War I, the prosperity of the twen- 
ties, and the depression of the thirties. James West describes the 
nature of a very small community in the Ozark region in Plainville, 
USA." Sherman and Henry !5 have studied the way of life of five 
"hollow" communities hidden away in the Blue Ridge mountains. 

Some community studies have singled out particular aspects for 
special investigation. ; Drake and Cayton!? have described life 

15 
des Debet D. ie aod Helen M. Lynd, Middletown (New York: Harcourt, 


16 Robert S. Lynd and Helen M. Lynd, Middletown in Transition (New 
York: Harcourt, Brace and Co., Inc., 1937). 

17 James West, Plainville, USA (New York: Columbia University Press, 
1945). 


18 Mandel Sherman and Thomas R. Henry, Hollow Folk (New York: Crowell 
Publishing Co., 1933). 


19 St, Clair Drake and H. R. Cayton, Black Metropolis (New York: Harcourt, 
Brace and Co., Inc., 1945). 


DESCRIPTIVE RESEARCH 115 


in the Negro section of Chicago. Hollingshead ?? has portrayed 
the status of adolescents in a small Illinois community. Warner ?! 
and his associates have delineated the social clas$ structure of a 
New England community in their story of Nesvburyport, Mass. 


CAUSAL COMPARATIVE STUDIES 


Another type of descriptive research seeks to find the answers to 
problems through the analysis of causal relationships. What fac- 
tors seem to be associated with certain occurrences, conditions, or 
types of behavior? Since it is often impracticable to arrange oce 
currences, an analysis of what actually does happen is the only 
feasible way t& study causation. 

For example, we would not arrange fatal automobile accidents in 
order to study their causes. But we can study the conditions asso- 
ciated with fatal accidents to attempt to find the factor or factors 
associated with them. Police departments, safety commissions, and 
insurance companies are constantly studying the problems of high- 
way safety. If the causes of accidents could be determined, cer- 
tain preventative measures could be adopted. Such factors as ex- 
cessive speed, poor mechanical condition of the vehicles involved, 
driving under the influence of alcohol, and many other factors 
have been blamed. 
| By the methodology of descriptive research, the relative impor- 
tance of these factors may be investigated. If, for example, exces- 
sive speed were associated with a high proportion of fatal acci- 
dents, state legislatures could attack the problem of highway safety 
by passing more stringent laws controlling speed, or by more 
rigid enforcement of existing speed laws. If a high proportion 
of vehicles involved in accidents revealed mechanical defects, com- 
pulsory, periodic vehicle inspection might be effected. The need 
for engineering improvements in auto construction might also be 
suggested. 3 


20 August B. Hollingshead, Elmtown's Youth (New York: John Wiley and 


Sons, Inc., 1949). M NE 
21 W. Lloyd Warner and Paul S. Lunt, Social Life of a Modern Community, 
Vol. I, "Yankee City Series" (New Haven: Yale University Press, 1941). 


^ 
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| Studies of juvenile delinquency may compare the social and edu- 
cational backgrounds of delinquents and nondelinquents. What 
factors, if any, were common to the delinquent group? What fac- 
tors, if any, were common to the nondelinquent group? Any factors 
common to one group, but not to the other, might serve as a pos- 
sible explanation of the underlying causes of delinquency. 

Some efforts have been made to associate good or poor teaching 
with the type of educational institution in which the teachers pre- 
pared. Those studies have proved inconclusive, possibly for a 
number of reasons. In addition to the difficulty of finding a valid 
ahd satisfactory criteria of good and poor teaching, many factors, 
other than type of college attended, seem to be significant. Such 
variables as quality of scholarship, Socio-economic status, personality 
qualities, types of nonschool experiences, attitudes toward the teach- 
ing profession, and a host of others have possible relevancy. 

It is apparent that while the causal comparative method has some 
merit in solving social problems, it has many limitations. Failure 
to single out the really significant factor, failure to recognize that 
events often have multiple rather than single"causes, basing con- 
clusions on a too-limited number of Occurrences, and failure to 
recognize that factors may go together without having a cause- 
effect relationship, may lead the researcher to false or misleading 
conclusions, 

A humorous example of spurious causal relationships is illustrated 
by the man who became drunk when he drank water mixed with 
gin, water mixed with bourbon, and water mixed with brandy. He 
concluded that, since Water was associated with each 


apparent 
cause, he would reform by giving up water. 


/ 


\ ACTIVITY ANALYSIS IJ 
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thousands of jobs are carefully studied, jobs ranging in complexity 
from that of unskilled laborer to that of plant manager. | 

In school systems the roles of the superintendent, the principal, 
the teacher, and the custodian have been carefully analyzed to dis- 
cover what these individuals do and need to be able to do. The 
Commonwealth Teacher Training Study ?? made under the direc- 
tion of Charters and Waples described and analyzed the activities 
Of several thousand teachers, and searched previous studies for 
opinions of writers on additional activities in which classroom teach- 
ers should engage. 

This type of analysis may yield valuable information that would 
"prove useful in; i 


Establishing the requirements for a particular job or position. 
Setting up a program for the preparation or training of individuals 
for various jobs or positions. 

Setting up an in-service program for improvement in job com- 
petence, or for the up-grading of individuals already employed. 
Establishing equitable wage or salary schedules for various jobs or 
positions. ^ ^ 


o ^ 


TIME-AND-MOTION STUDY 


bee GO Rer 


This more highly refined type of analysis in industrial plants con- 
sists of the observation and measurement of actual body movements 
involved in the performance of a production job. The stop watch 
and the motion picture camera are frequently used to make the 
Observation and measurement more exact. 

Studies of this type may result in improved design of machinery 
and equipment, more effective placement and flow of materials, and 
reduction of waste motion and fatigue. All of these factors may 
result in increased hourly output of both worker and machine. ) 


| CONTENT OR DOCUMENT ANALYSIS . _- 


\ Content analysis, sometimes known as document analysis, deals 


22W, W. Charters and Douglas Waples, The Commonwealth Teacher Train- 
ing Study (Chicago: The University of Chicago Press, 1929). 
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with the systematic examination of current records or documents as 
sources of data. While documents usually consist of written or 
printed words or figures, they may be of the graphic type, and in- 
clude paintings, dxawings, cartoons, or photographs. Some studies 
may merely gather and classify factual data from the official reports 
of institutions or organizations. Other studies may classify and 
evaluate the contents of documents according to established criteria, 
The frequency of appearance or the proportion of space occupied 
may provide a basis for the analysis of other data. 

It is well to remember that the emphasis in documentary materials 
is not always accurately evaluated by frequency of appearance or 
quantity of space occupied. The aspect of intensity through the 
use of prominence of position or emotionally loaded terms may well 
lend emphasis in ways quite unrelated to quantity alone, 

In using documentary sources, one must bear in mind the fact 
that data appearing in print are not necessarily trustworthy. The 
evaluation of documents used in descriptive research must be sub- 
jected to the same careful type of criticism employed by the his- 
torian. Not only is the authenticity of the document important, 
but the validity of its contents is crucial The burden of proof 
lies with the researcher, | It is his obligation to establish the trust- 
worthiness of all data that he draws from documentary sources. 

In documentary analysis the following may be used as sources 
of data: official records and reports, printed forms, textbooks, refer- 
ence books, letters, autobiographies, diaries, compositions, themes 
or other prepared work, books, magazines, newspapers, college 


bulletins or catalogues, syllabi or courses of study, pictures, films, 
and cartoons, 


| The following purposes may be served through documentary ' 


analysis: (Examples of actual studies are given as illustrations.) 
1. To describe prevailing practices or conditions. 
Entrance Requirements of Ohio Colleges as Revealed by an 
Analysis of College Bulletins. 
Criteria for Primary Pupil Evaluation Used on Marion County 
Report Cards. 


- To identify the literary style, con 
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. To discover the relative importance of, or interest in, certain 


topics or problems. 

Public Information on Education as Measured by Newspaper 
Coverage in Three Indianapolis Daily Newspcpers during the 
Month of December, 1958. 

Statistical Concepts Presented in College Textbooks in Educa- 
tional Research, Published since 1940. 


. To discover level of difficulty of presentation in textbooks or 


in other publications. 
The Vocabulary Level of Intermediate Science Textbooks. 
Abstract Concepts Found in First Grade Readers. 


. To evaluate bias, prejudice, or propaganda in textbook presen- 


tation. 

The Soviet Union as Presented in High School History Text- 
books. ; 

The Free Enterprise System as Pictured in High School Social 
Problems Textbooks. 

Racial and Religious Stereotypes ire Junior High School Litera- 
ture Textbooks. 


. To analyze types of errors in students’ work. 


Typing Errors of First Semester Typing Students at Shortridge 
High School. 

Errors in. English Usage Found in Letters of Application for 
Admission to the University of Wisconsin. 


16. To analyze the use of symbols representing persons, political 


parties or institutions, countries, or points of view. 

Great Britain as a Symbol, As Represented in New York City 
Newspaper Cartoons in the Decade, 1930-1940. 

The New Dealer as Depicted in the Americar: Press from 1932 
to 1942. 

cepts, or.beliefs of a writer. 


Shakespeare's Use of the Metaphor. 
Alexander Campbell's Concept of the Trinity, 


His Sermons. 
John Dewey's Interpretation of Education as Growth. 


as Revealed in 
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Content or document analysis should serye a useful purpose in 
research, adding important knowledge to a field of study, or yield- 
ing information that ïs helpful in evaluating and improving social 
or educational practices. ` Since there are so many significant areas 
of knowledge to be investigated, setting up studies for the pure joy 
of counting and tabulating has little justification. Such investiga- 


| The follow-up study investigates individuals who have left an 
institution after having completed a Program, a treatment, or a 


ate various aspects of its Program in light of actual results. 
\ Dillon’s 23 study of early school leavers has yielded information 
that may lead to the improvement of the curriculum, guidance sery- 


ices, administrative Procedures, and thus the holding power of the 
American secondary school, 


23 Harold J. Dillon, Early School Leavers, Pub, #401 (New York: National 
Child Labor Committee, 1949), 

24 May V, Seagoe, “A Follow-Up Study of 314 Students Whose Fitness for 
Teaching Was Questioned.” Journal of Educational Research, 50:9, May 1957, 
2p. 641-53. 
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Terman and Oden restudied a group of gifted children after 
a period of twenty-five years. An effort was made to evaluate the 
influence of giftedness upon their status as adults, and upon their 
contribution to society. 8 

Havemann and West?9 have made a follow-up study of almost 
10,000 college graduates. Graduates of over one thousand colleges 
were studied. Significant data were gathered on their occupations 
and incomes, family life, social and community service activities, and 
their outlook on political, social, and economic issues. 


2 


TREND STUDIES — * 


e 


= The trend, or predictive, study is an interesting application of the 
descriptive method. In essence, it is based upon a longitudinal 
consideration of recorded data, indicating what has been happen- 
ing in the past, what the present situation reveals, and on the basis 
of these data, what will be likely to happen in the future. For 
example, if the popylation in „an areg shows consistent growth over 
a period of time, one might predict that by a certain date in the 
future the population wilbreach a given level. These assumptions 
are based upon the likelihood that the factors producing the change 
or growth will continue to exert their influence in the future. The 
trend study points to conclusions reached by the combined methods 
of historical and descriptive analysis. 

An excellent example of the trend study is presented in An Eco- 
nomic Portrait of Indiana in 1970: Indiana's Economic Resources 
and Potential?! In this projection such elements as population, 
school enrollments at various levels, agricultural and industrial 
Production, employment and the labor force, retail sales, electrical 


The Gifted Child Grows Up: 


?5 Loui lita H. Oden, 
WR i DADA (Stanford, California: Stan- 


f a aei fioa Years Follow-Up of a Superior Group 

ord University Press, 1947). 

26 Ernest Hemana and Patricia West, They Went to College: The College 

Graduate in America Today (New York: Harcourt, Brace and Co., Inc., 1952). 
27 School of Business, Indiana University, An Economic Portrait of Indiana 

in 1970: Indiana's Economic Resources and Potential (Bloomington, Ind.: 

1956). 
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energy production, tax revenues, auto registrations, and the Indiana 
gross product are predicted. 

| This type of study furnishes valuable data for planning programs, 
in"whatever area they may be. Of course, such predictions are esti- 
Mates, representing tentative conclusions only. \Wars, economic 
recessions, great technological discoveries, and many other unfore- 
seen events could hasten or arrest the processes of growth or devel- 
opment. 

The President's Commission on Higher Education 28 has used the 
process of trend analysis to forecast the doubling of college enroll- 
thents by 1970, These trends have important implications for college 
officials, who must find ways of providing buildings and equipment, 


teaching staff, and financial support for a greatly expanded. pro- 


gram of higher education. Basing these predictions on an ever- 
increasing number of secondary-school graduates, and the constantly 
increasing proportion of graduates who continue their education, 
the Commission anticipates that a flood of young people will be 
knocking at college and university doors in coming years. 

u a 


SUMMARY 


Descriptive research, the predominate research method of the 
behavioral sciences, is concerned with prevailing conditions. In 
addition to description there is an element of interpretation of the 
meaning or significance of what is described. Knowledge of present 
Status is a necessary first step in problem-solving, Descriptive re- 
search may also be used to identify goals or objectives and the ways 
in which they may be reached. 

The survey gathers data from a relatively large number of cases 
at a particular timé. The survey method is applied to the analysis 
of existing social conditions, including educational conditions, and 
to 'the analysis of public opinion. 

The case study gathers data more intensively from a single case 


28 Second Report to the President, President's Committee on Education Be- 
yond the High School (Washington: July, 1957). 
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or from a limited number of typical cases. It is concerned with 
the life history, or an important part of the life history, of a particular 
case. It is concerned with change or growth over a period of time. 
Communities, types of individuals, social groups, or institutions may 
be considered as cases for analysis. 

Causal comparative studies analyze the relationships between 
factors that may help to explain why certain conditions prevail. 
Activity analysis describes the nature of the processes involved in 
a job or an activity. Time-and-motion studies represent a more 
intensive analysis of the actual body movements involved in a 
process or operation. Document analysis examines the content of* 
written or printed materials as a source of data. The follow-up 
study investigates the influence that a course of study, a process, 
or an institution has had upon an individual or a group of indi- 
viduals. Trend, or predictive, studies, by a careful analysis of past 
events and present conditions, attempt to predict conditions that 
are likely to prevail in the future. g 

Descriptive research involves more than fact-gathering and tabu- 
lation. It deals witl? the analysis and interpretation of the data 
-which have been gathered for a specific purpose, for the understand- 
ing and solution of significant problems. 
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EXPERIMENTAL RESEARCH 


EXPERIMENTAL RESEARCH IS THE DESCRIPTION AND 
analysis of what will be, or what will occur, under carefully con- 
trolled conditions. It is the classical methodelogy of the science 
laboratory, and is probably the most difficult and most exacting of 
all methods of research. While experimental research finds its 
Greatest utility and application in the laboratory, where conditions 
can be rigorously controlled, it has been applied with some success 
125 
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in the school classroom where, within certain limits, significant fac- 
tors or conditions can be controlled. 

The basic assumption of experimental research rests upon what 
is known as the law of the single variable. John Stuart Mill defined 
this principle in 1872 in his rules or canons; 1 


element added. Or, if two situations are alike in every respect, and 
one element is removed from one but not from the other, any differ- 
ence that develops may be attributed to that element subtracted, 


LABORATORY RESEARCH S 


The law of the single variable has always provided the basis for 
laboratory experimentation. In 1662 Robert Boyle, an Irish physi- 
cist, used this methodology in arriving at the principle on which 
he formulated his law of gases. He discovered that when the tem- 


Vi 4 Po (In Boyle’s Law pressure is the 
Vs P, single variable.) 


A little more than a century later, Jacques A. C. Charles, a French 
physicist, discovered a companion principle, now known as Charles" 


» yoon Stuart Mill, A System of Logic (New York: Harper & Brothers, 1873), 
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Law. He observed that when the pressure is held constant, the 
volume of an ideal gas is directly proportional to the temperature. 


Vi _ Ti (In Charles’ Law temperature is 
Və Te the single variable.) ë 


In the psychological laboratory significant experiments have been 
conducted investigating the nature of instinct, reflex habit, motiva- 
tion, memory, transfer of training, and other aspects of behavior. 
Using as subjects rats, dogs, cats, chickens, guinea pigs, and apes, 
such stimuli as hunger, pain, color, electric shock, and noise have 
been introduced as variables. Many basic principles of behavior. 
have been discovered, many of them applicable to the interpreta- 


tion of human Behavior. 


MEDICAL RESEARCH 


- 


In many situations involving human beings the principle of the 
single variable has been effectively employed. During World War 
II, the Commission on Medical Research of the Office of Scientific 
Research and Development was interested in discovering the effec- 
tiveness of certain seasickness remedies. A staff of researchers from 
the California Institute of Technology, under the direction of Dr. 
David Tyler, carried on a series of 90 experiments over a period 
of six months,? using over 20,000 service men as subjects, chosen at 
random from a population of over 100,000. Various medical prep- 
arations were tested. The most effective was a compound made 
Up of a barbiturate and a belladonna derivative. 

To one experimental group of men on troop 
Various types of landing craft, regular dosages of the drug were 
administered. To'another group, a harmless powder (known as 2 
Placebo) was administered. No medication was given to the third 


(or control) group. It was discovered that the group having no 


medication suffered most. Those receiving the placebo suffered 


transports and on 


uary 2, 1946, p. 57. By 


2« + » Week, #857, Febru 
Seasickness Drug," Business Week, # Hill Publishing Co., Inc. 


special permission, copyrighted © 1946 by McGraw- 
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only a trifle less incidence of nausea (1 per cent less than the control 
group, while those who received the drug suffered from 40 per cent 
to 80 per cent less. Its use also improved rifle marksmanship after 
landing by 12 per cent. : 

This series of experiments, based upon the law of the single 
variable, proved the effectiveness of the drug in combatting sea- 
sickness. The placebo was administered to discount the psycho- 
logical effect that a harmless powder would have. Any treatment, 
even though of no recognized medical value, seems to exert some 
helpful psychological effect on a subject. The effectiveness of the 
medication is then measured by its superiority over the placebo, 
thus subtracting the purely psychological factor from the experi- 
ment. 

On the week of April 26, 1954, an experiment was conducted in- 
volving 1,830,000 children in every part of the United States which 
had a high poliomyelitis rate, Using the Salk vaccine as an experi- 
mental factor, three intramuscular innoculations of 1 cc. each were 
administered to 440,000 children, with the second and third innocu- 
lations coming one week and five weeks after the first, respectively.3 
A saline solution, or placebo, was administered to another group of? 
210,000 children, while a third group of 1,180,000 children was 
designated as a control group and received no medication. 

After a period of time the records of the three groups were 
analyzed, The experimental group receiving the Salk vaccine had 
a far more favorable record. In spite of the fact that many children 
might have received the vaccine too late to be completely effective, 
only fifty-seven developed symptoms of poliomyelitis and only one 
died. In the words of Dr. Thomas D. Dublin, 


It is almost universally known that this basically medical test—unprece- 
dented in its objectives, its magnitude, and its scope, has been highly 
successful, and there is now available to the public a safe and simple 
measure offering 60-50 per cent protection against paralytic poliomye- 
litis.4 


8 Thomas D. Dublin, “1954 Poliomyelitis Field Trial,” Journal of American 
Medical Association, 158:14, August 6, 1955, pp. 1258-1265. Used with per- 
` mission. 
4 Ibid., p. 1265. 
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The Salk vaccine was the single variable, and the reduction of the 
incidence of poliomyelitis was ascribed to its use. 

In the two medical experiments mentioned there was no effort 
made to keep all variables constant. The groups were selected by 
a type of random selection. What variables existed were consid- 
ered relatively unimportant to the testing of the hypothesis that the 
given medicine would be effective in the prevention of the illness. 
Thus, we find what might be called a modification of the law of the 
single variable, the law of the only significant variable; the medica- 
tion was the only significant factor among many others that un- 
doubtedly existed. 1 


o 


CLASSROOM RESEARCH 


In bringing the experimental method of research into the school 
classroom, complex human beings are the subjects, and it is un- 
likely that all variables could ever be controlled. Most classroom 
experiments have attempted to eliminate one or more of the vari- 
ables of age, achievemert, intelligence, and sometimes such variables 
às reading ability, socio-economic status, and race. But since the 
organization of the typical school cannot justifiably be rearranged 
for the purpose of experimentation, most experiments must be con- 
ducted using intact, existing class groups, trusting that the variables 
not controlled are irrelevant, or would not seriously alter the results 
obtained. It is clear that there are, however, countless factors that 
can and do influence teaching-learning situations at a particular 
time; factors affecting both teacher and pupil. A few of these 
difficult- or impossible-to-control variables are: 


ar method or material. 


1 i articul 
Teacher enthuse E lar method or with a particular 


2. Teacher competence in à particu 
à material. 
4. Regularity of ation An ufifavorable condition 


i f the child. 
Mental or emo iT a cold or fever, quarrel with a friend, 


i i ily di the break- 
lack of sleep the previous night, family disharmony at 

fast table, Soot breakfast, unsuccessful experience with a test the 
previous period, concern about an important after-school activity, 


personal relationship with the teacher, and other factors too numer- 


ous and too complex to control. 


may result from indigestion, 
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This recital of less-than-perfect experimental conditions is not 
intended to deprecate the classroom experiment. With all of its 
limitations, the process of experimental research in the classroom has 
some merit, even though the rigorous controls of the science labora- 
tory cannot be maintained. 


CLASSROOM RESEARCH METHOD 


Research in the classroom has usually endeavored to establish 
as the significant variable a teaching method, the use of a particular 
teaching material, or an administrative arrangement such as class 
grouping, seating arrangement, or some physical feature of the 
classroom. 

The pattern involves a comparison of the effectiveness of a new 
method, arrangement, or device—known as the experimental factor 
—with the customary method or device—the control factor. The 
criterion is usually pupil growth in skills and knowledge, which 
can be measured by some type of testing program. The process 
can be illustrated by a simple diagram. „ 


Experimental Group 1; Control Group 
1. Pretest 1. Pretest - 
2. Application of experimental factor 2, Application of control factor 
3. Final test 3. Final test 
4. Measure pupil mean gain (Final 4. Measure pupil mean gain (Final 
test scores minus pretest scores) test scores minus pretest Scores) 


The difference between the control pupil mean gain and the experi- 
mental pupil mean gain would indicate the relative superiority of 
the method or factor showing the greatest pupil gain. 

It is important to note that in addition to controlling all of the 
variables except the method used, another difficult problem con- 
fronts the classroom experimenter. Educators are generally aware 
of the difficulty of devising tests or measuring instruments that 
accurately measure’ the amount of pupil gain. To measure the 
acquisition of limited facts and information is fairly feasible, but to 
measure all of the important products of learning is much more 
difficalt. It is obvious that the satisfactory measurement of pupil 
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gain in a classroom experiment presumes that the tests used have 
a high degree of validity and reliability. Without tests that really 
measure the products of learning that are important, and that con- 
Sistently produce equivalent scores, classroom experimentation of 
this type can produce no usable evidence. Developing tests of 
Satisfactory validity and reliability is one of the most important 
phases of the research problem. 


PATTERNS OF CLASSROOM RESEARCH 


l. Single individual or single group. 
2. Parallel, equated groups (two or more). 
a) Equated by random sample. 
b) Equated by mean scores. 
c) Equated by matched pairs. 
d) Co-twin method. 
3. Rotational method. 
a) Single group. 
b) Parallel, equated groups. 


l. Single individual or single group 


This type of experiment is carried on with one individual or one 
group of individuals. Since the discussion here deals with research 
in the Classroom, the single group experiment is described. This 
iype is probably the easiest to manage, for it requires little or no 
fampering with intact, existing classes. The same students are 
used throughout the experiment, and their achievement under one 
Condition i. compared with their own achievenient under another 
Condition rather than with the achievement of another group. 

€ process consists of pretesting the group, teaching a unit of 
Work by a conventional (control) method, and final testing and 
measurement of the pupil average or mean gain. Then, a different 
unit of work is started with a pretest. After the experimental teach- 
ing method is applied, a final test is given and the mean pupil-gain 
!5 computed, The pupil mean gain for the control unit is compared 
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with the pupil mean gain for the experimental unit. A judgment 
is then made on the basis of which of the methods, control or experi- 
mental, produced the greatest pupil mean gain. 

In choosing units of work for single group experiments it is very 
important that: 

1. The units of work be of equal difficulty. 

2. The units be equally interesting. 

3. An equal amount of time be allowed for each unit. 

4. The tests produce scores of equal scale value. 

Upon first examination it would seem that the single-group 
method might provide an almost ideal way of controlling all of 
the variables except one, the teaching method employed. Closer 
examination, however, reveals many variables that remain and that 
cannot easily be controlled. ? 

1, The teacher may have more competence in, or enthusiasm 
for, one of the methods. 

2. The second phase of the one group experiment involves stu- 
dents who are a little older and a little more mature than they were 
when they entered the first’ phase... v 

3. Certain learnings and techniques of learning resulting from 
the first unit may have been carried over to. the second, influenċing 
the amount of pupil gain. Even the practice effect of the particular 
type of tests used might produce some advantage accruing to the 
method of the second phase. 


4. The novelty of any new method might produce greater gain, 
regardless of its real merit. 


Il. Parallel, equated groups (two or more) 


Some, but not all, of these limitations can be avoided by using 
the method of carrying on the teaching methods simultaneously 
in parallel, equated groups. The problem here is equating the 
groups, or getting groups that are as nearly equal as possible. 
There are four ways in which groups may be equated: 

1. By random selection. It is assumed that if both groups are 
seiécted from a very large population by some system of random 


EXPERIMENTAL RESEARCH 133 


selection, the groups will tend to be about equal in composition. 
(See Chapter 7, "Sampling.") 
2. By equating on the basis of mean scores and standard devia- 
tions. This method would involve the selection,of groups whose 
mean ages, intelligence scores, and other factors considered sig- 
nificant were about the same. The equating of variations from 
the mean would also be necessary in order to assume that the groups 
were about equal in homogeneity. 
3. By matched pairs. This method involves finding pairs of stu- 
dents whose characteristics are as nearly alike as possible—age, 
sex, intelligence, home background, race, and others. Then one 
of the pair is assigned to the control group and the other to the 
experimental group. On the assumption that sums of equals are 
equal, the two groups would be equated, thus eliminating most of 
the variables except the method under investigation. 
=- 4. By co-twin method. This method separates pairs of identical 

twins, placing one in the control group and the other in the experi- 

mental group. While this method has been used with some suc- 
“cess in studying the relative influence of heredity and environment 
with limited numbers of children, it is not feasible for most class- 
room experiments. In most school systems it would be practically 
impossible to find enough pairs of identical twins at any grade 
level to make such grouping possible, to say nothing of the adminis- 
trative problems of setting up such equated groups. 

The limiting factors of the parallel-equated-group method of 
€xperimental research have already been implied. The difficulty 
of €quating groups, the tremendous administrative problems in- 
volved in reorganizing classes, the ever-present element of teacher 
Competence and enthusiasm, and the problem of satisfactory validity 
and reliability of the measuring instruments are all difficult elements 
for the researcher to handle. 


[3 
Ç 


Three-group design 


For purposes of simplicity of explanation, up to this poirt two 
parallel groups have been described, a control group and an experi- 
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mental group. Another pattern of experimental design provides for 
three parallel, equated groups operating simultaneously. In addi- 
tion to the control group and the experimental group a third group 
is set up, using some variation of the experimental factor. 

An example of this procedure is illustrated by an experiment, 
conducted at San Francisco State College, that was designed to 
evaluate the effectiveness of the teaching of college courses by tele- 
vision. Dr. Thomas P. Lantos, operating with a Ford Foundation 
grant, taught a course in “The American Economy” to three groups 
of carefully matched college sophomores. 

One group was taught by the conventional class-lecture method. 
A second group listened to the semiweekly lectures via closed- 
circuit television, also in a campus classroom, having no way to 
escape the lectures except by daydreaming. The third group stayed 
at home and viewed the lectures on their own television sets, and 
were free to listen or pass up the lecture as they wished. 

All groups participated in a weekly on-campus class discussion, 
used the same textbooks, took the same examinations, and had the 
same instructor. Dr. Lantos reports that preliminary evaluation of 


these tests and examinations showed no significant differences 
among the three groups.5 


Ill. Rotational methods 


The third pattern of experimental design is applicable to, and 
presents a variation of, both individual and parallel-equated-group 
methods. It involves rotating the order of procedures or of groups. 

As applied to the single group method, it would involve changing 
the time sequence of the control and experimental units presented. 

Cycle I would present the control method first, then the experi- 
mental method. 


Cycle II would present the experimental method first, then the 
control method. 


5 Thomas P. Lantos, “A Professor Converts to the Electronic Age,” The Re- 
porter; 16:13, May 30, 1957, p. 15 Used with permission. 
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As applied to parallel, equated groups: 

Cycle I: Group A—experimental method 
Group B—control method 

Cycle II: Group A—control method G 
Group B—experimental method 


If a particular teaching method consistently produced superior 
pupil gain, no matter in what order or to which group it was ap- 
plied, its superiority would be confirmed with much greater con- 
fidence. This technique of rotation would tend to minimize the 
influence of uncontrolled factors and to provide a more convincing’ 
test of the superiority of the particular method under investiga- 
tion. j 

In concluding the discussion of the experimental method in class- 
room research, several points should be emphasized: 

1. Since the public schools do not exist for the purpose of experi- 
mentation, the administrative difficulties of manipulating individuals 
and groups for such ends often preclude the possibility of applying 
some of the technique» described. 1 

2, Experimental research conclusions cannot be applied generally 
outside the specific group or^groups studied, unless the groups have 
been carefully composed of individuals chosen at random from a 
large population. The type of experimental design that involves 
sampling procedures and the interpretation of statistical data re- 
Sulting from these procedures calls for an expertness that few 
Classroom teachers possess. 

3. At several points in the discussion attention has been called 
to the difficulty of achieving control over the many variables that 
are present in the school classroom. Many statistical techniques 

ave been developed to handle several variables simultaneously 
in the experimental situation. Such devices as random blocks, 
Latin Squares, analysis of variance and co-vaziance, partial and 
multiple correlation, and other procedures are quite technical and 
beyond the scope of a general treatment of research. Satisfactory 


ê See discussion of descriptive and inferential statistics in Chapter 7. 
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explanations may be found in most advanced textbooks in educa- 
tional statistics. 

4. It should be remembered that the effectiveness of teaching- 
learning in any classroom situation can rarely be attributed to a 
single factor. Thus, even though the single variable might be 
successfuly isolated, great caution should be exercised in inter- 
preting the resulting experimental conclusions. 

5. It is possible that setting up a carefully controlled experiment 
in the classroom might result in an artificial teaching-learning situ- 
ation. Consequently, the conclusions based upon such conditions 
may have limited relevancy for more normal classroom situations 
and procedures. : 

6. Since the conclusions derived from classroom experiments are 
usually based upon test results, the researcher should be cautious 
about the use of nonstandardized, teacher-made tests. If possible, 
there should be employed a variety of standardized instruments 
which validly and reliably measure those broad products of learn- 
ing which a sound philosophy of education recognizes as important. 

On the more positive side of thé evaluation of experimental re- 
search in the classroom, several additional points may be noted: 

1. For most classroom teachers, an action-type research investiga- 
tion should prove most satisfactory. Since the superiority of an 
experimental teaching method may prove to be convincing, common 
sense would suggest its use, without the need for elaborate tests of 
statistical significance, provided that there is no presumption of its 
superiority for other groups in other situations. 

2. Many large school systems have research departments and 
highly qualified research personnel who may justifiably carry on 
more pretentious experiments, under carefully controlled conditions, 
and using the best statistical techniques of control and interpreta- 
tion. It is important to the development of education as a profes- 
sion that these inferential studies be conducted by qualified experts. 

3. Teachers who experiment in their classrooms, even modestly, 
tend to grow in teaching skill. The mere process of setting up a 
steady, carefully planning procedures, attempting to control factors, 
and accurately evaluating results of new teaching methods is con- 


Í 
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ducive to the improvement of the teaching-learning process, as well 
as the professional growth of the experimenter. Good administra- 
tors and consultants encourage this type of activity. 

Those who engage in, and publish the results of, educational 
experiments are expected to define the problem carefully, to explain 
all basic assumptions, to define all necessary terms, and to describe 
in detail all procedures and all measuring devices used for evalua- 
tion, Only with this information can other students of research 
evaluate the conclusions and the worth of the research project. 


f SUMMARY 


Experimental research describes what will be when all relevant 
conditions are carefully controlled. The basic assumption of the 
experimental method rests upon the law of the single variable de- 
scribed by John Stuart Mill in his laws, or canons. In brief, the law 
of the single variable states that if twð situations are alike in every 
respect, and one element is added to one but not to the other, any 
difference that results is the effect of the. operation of the added 
element. Or, if two situations are alike in every respect, and one 
element is removed from one but not from the other, any difference 
that results may be attributed to the subtracted element. 

Although the experimental method has traditionally been the 
method of the science laboratory, where conditions can be rigor- 
ously controlled, social scientists have attempted to carry it to the 
field, where more lifelike conditions prevail. In the classroom the 
experimental method may contribute to the improvement of educa- 
tional practices. While it is admittedly difficult to control all of 
the many factors that influence the teaching-learning situation, 
Classroom experiments have been successfully conducted. 

A comparison of the effectiveness of an experimental teaching 
method with that of a control method may be made by applying 
€ach procedure, and then measuring pupil mean gain by scores 
9n carefully designed achievement tests. If all significant facw;s 
except the specific teaching procedures can be held constant, the 
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method producing the greater amount of pupil mean gain may be 
presumed to be the more effective. 

Experimental designs may be established on the basis of a single 
individual, a single group, or two or more parallel, equated groups. 
Groups may be equated by means of random selection, by equaliz- 
ing mean scores and standard deviations, by selecting matched 
pairs, or by the co-twin method. Varying the order of application 
of the experimental and the control factors, known as the rotational 
method, may provide a more convincing test of the superiority of 
one teaching method over the other. 

Classroom teachers need to know the limiting factors that are 
inherent in classroom teaching-learning experiments. As a result 
of engaging in classroom experiments, teachers are likely to grow 
both in teaching skill and in professional spirit and awareness. 
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THE TOOLS OF RESEARCH 


TO CARRY OUT. ANY OF THE TYPES OF RESEARCH IN- 
vestigation described in the three preceding chapters, data are 
gathered from which the hypothesis may be tested. A great variety 
of research tools has been developed to aid in the acquisition of 
data. These tools are of many kinds and employ distinctive ways 
of describing and quantifying the data. Each tool is particularly 
arzzopriate for certain sources of data, yielding information of the 
kind and in the form that would be most effectively used. 
140 
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Some of these devices merely identify the presence or absence 
of certain aspects of a situation. Others collect qualitative descrip- 
tions, which may involve comparisons or contrasts between elements 
present in the situation. Other devices yield quantitative meas- 
ures in scale measures or in scores. This measurement of what is 
identified adds an important dimension to description; not only 
what, but how much, is revealed. 

To say that it was a hot day yesterday and that it rained hard 
involves description. But to say that the temperature reached 93° 
Fahrenheit at 3:00 r.m., and that an inch of rain fell between 4:00 
and 6:00 p.m., quantifies the description, adding a much more pre* 
cise element. + 

Many of the tools of research have been designed to yield quan- 
titative measures. Others yield description that may be refined 
by counts of frequency of appearance. A visitor may observe that 
a number of children wear glasses in Room A, and that fewer chil- 
dren seem to wear them in Room B. A frequency count might 
verify the observation. Eight bespecfacled students of thirty-two 
in Room A would indicate thàt 25 per cent wear glasses. Three 
“students wearing glasses of thirty in Room B would indicate a per- 
centage of ten. Thus, the observation is more precisely stated by a 
frequency count and a percentage comparison. 

This quantification of data is an essential part of research. 
While some judgments cannot be expressed in frequency counts, 
percentages, or scores, most data are made more meaningful by 
quantification. In addition to frequency counts and percentage or 
fractional comparisons, data may be refined by numerical ratings, 
rank-order placement, paired comparisons, social-distance scales, 
€qual-appearing intervals, summated ratings, and standardized score 
values. A number of these scaling procedures are described later 
in this section. 

Many writers have argue 
the questionnaire, or the psychologic 
is difficult to see merit in this approac 
sity of Wisconsin teacher and researcher, 
of this sort by asking, “Which is better, a 


d the superiority Of the interview over 
al test over the interview. Tt 


h. Dr. A. S. Barr, a Univer- 
would resolve disess‘ons 
hammer or a handsaw?" 
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Like the tools in the carpenter's box, each research tool is appro- 
priate in a given situation to accomplish a particular purpose. Each 
data-gathering device has both merits and hazards or limitations. 

Many research investigators use a variety of these devices in 
gathering the data necessary for the testing of the hypothesis. 
Students of research should familiarize themselves with the advan- 
tages and limitations of each device. They should attempt to 
develop skill in the construction and use of each of these useful 
tools. 


INQUIRY FORMS 


The term inquiry form is a general classification of data-gathering 
devices in which the data are obtained from the respondent in 
written form. When the form is filled out in the presence of the 
questioner, it is usually referred to as a schedule. When it is 
administered by mail, it is referred to as a questionnaire. When 
its purpose is to gather opinions rather than facts, it is often known 
as an “opinionnaire” or attitude scale, H 


The schedule 


Schedules administered personally to groups of respondents have 
several advantages, The opportunity to establish rapport, to ex- 
plain the purpose of the investigation, and to explain the meaning of 
items that may not be clear, the availability of respondents, and 
the economy of time and expense are all advantages that a ques- 
tionnaire administered by mail cannot provide. In addition, the 
schedule type may provide almost all complete and usable returns. 
It is likely that a principal would get completely usable responses 
from the teachers in his building. A teacher should obtain complete 
returns on schedules administered to students in the classroom. 

However, individuals who have the desired information cannot 
always be contacted personally, either for an interview or for the 
completing of a personally administered Schedule. There are times 
wheii’a personal contact would be too expensive or time-consuming. 
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It is in these situations that the questionnaire administered by mail 
makes its contribution as a technique of data-gathering. 


The questionnaire 2 


The questionnaire is probably the most used and most abused 
of the data-gathering devices. Perhaps most criticism has been 
directed at its misuse rather than at its use. It has been referred 
to as the lazy man’s way of gaining information, although the care- 
ful preparation of a good questionnaire takes a great deal of time, 
ingenuity, and hard work. There is little doubt that the poorly 
constructed questionnaires that food the mails have created a cer- 
tain amount of contempt. Particularly is this true when the accom- 
panying letter pleads that the sender needs the information to com- 
plete the requirements for a graduate course, a thesis, or a disserta- 
tion. The recipient's reaction may be, “Why should I go to all 
this trouble to help this person get his degree?” 

Filling out lengthy questionnaires tgkes a great deal of time and 
effort, a favor that few senders have any right to expect of strangers 
"The unfavorable reaction is intensified when the questionnaire is 
long, the subject trivial in importance, the items vaguely worded, 
and the form poorly organized. The unfavorable characteristics of 


aires help to explain why so small a proportion 


so many questionn 
returned, As a result of this 


of questionnaires sent out by mail are 
Sparse response, the data that are obtained are often of limited 


validity. The information in the unreturned questionnaires might 
have changed the results of the investigation materially. The very 
fact of no response might imply certain types of reaction, reactions 
that can never be included in the summary of data. 

Unless one is dealing with a group of respondents who have a 
Senuine interest in the problem under investigation, who know the 
sender, or who have some common bond of lóyalty to a sponsoring 
institution or organization, the results are frequently disappointing, 
and provide a flimsy basis for generalization. f ! 

While the foregoing discussion may have seemed to discredit the 
questionnaire as a respectable research technique, the attempt has 
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been to consider the abuse or misuse of the device. Actually, the 
questionnaire has unique advantages and, properly constructed and 
administered, it may serve as a most appropriate and useful data- 
gathering device in a particular research project. 


The closed form 


Questionnaires that call for short, check responses are known as 
the restricted or closed-form type. They provide for marking a 
yes or no, a short response, or checking an item from a list of sug- 


gested responses. The following example illustrates the closed-form 
item: 


Why did you choose to do your graduate work at this 
university? Kindly indicate three reasons in order of 
importance 
Rank 
a) Convenience of transportation 
b) Advice of a friend 
c) Reputation of institution 
d) Expense factor 
€) Scholarship aid , 
f) Other 


(Kindly specify) 


Even when using the closed form, it is well to provide for un- 
anticipated responses. Providing an “other” category permits the 
respondent to indicate what might be his most important reason, 
one that the questionnaire builder had not anticipated, Note the 
subtitle “(Kindly specify),” which enables the tabulator to prop- 
erly classify all responses. 

For certain types of information the closed-form questionnaire 
is entirely satisfactory. It is easy to fill out, takes little time, keeps 
the respondent ofi the subject, is relatively objective, and is fairly 
easy to tabulate and analyze. 


B 


The open form 


The open-form or unrestricted type of questionnaire calls for a 
-fee response in the respondent’s own words. The following open- 
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form item would seek the same type of information sought in the 
previous closed-form item: . 


State the reasons why you chose to take your graduate work at this uni- 
versity, 


Note that no clues are provided. The open form probably pro- 
vides for greater depth of response. The respondent reveals his 
frame of reference and possibly the reasons for his responses. This 
type of item, however, is sometimes difficult to interpret, tabulate, 
and summarize in the research report. 

Many questionnaires include both open- and closed-type items: 
Each type has its merits and limitations, and the questionnaire 
builder must decide which type is more likely to supply the informa- 
tion he wants. 


IMPROVING QUESTIONNAIRE ITEMS 


Inexperienced questionnaire makers, are likely to be naive about 
the clarity of their questions. "The author recalls a brilliant gradu- 
"ate student who submitted, a questionnaire for the professors ap- 
proval She seemed somewhat irritated and impatient at the sub- 
sequent questions and suggestions, and remarked that anyone with 
any degree of intelligence should know what she meant. At the 
advisors suggestion she duplicated some copies and personally 
administered the questionnaire to a graduate class in research. 

She was literally swamped with questions of interpretation, many 
that she could not answer clearly. There was considerable evidence 
Of confusion about what she wanted to know. After she had col- 
lected the completed questionnaires and had tried to tabulate the 
responses, she began to see the light. Even her directions and 


explanation in class had failed to clear up the intent of her ambigu- 


F " 3 e 
ous questionnaire. Her second version was 4 much-improved in 


Strument, 
Many beginning researchers are 
know. They use a shotgun approac 


n't really sure what they want to 
h, attempting to cover their 
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field broadly in the hope that some of the responses will provide the 
answers for which they are groping. Unless the researcher knows 
exactly what he wants, however, he is not likely to ask the right ques- 
tions, or to phrase them properly. : 

In addition to the problem of knowing what he wants, there is 
the difficulty of wording the questionnaire clearly. The limita- 
tions of words are particular hazards in the questionnaire. The 
same words mean different things to different people. The ques- 
tionnaire maker has his interpretation—the respondents may have 
many different interpretations. In the interview, or in conversation, 
we are able to clear up misunderstanding by restating our question, 
by inflection of the voice, by suggestions, and by a number of other 
devices. But the written question stands by itself, often ambiguous 
and misunderstood. 

A simple example illustrates the influence of voice inflection alone. 
Consider the following question. Read it over each time, accenting 


the word that is underlined, noting how the change in inflection 
alters the meaning. 


Were you there tast night? 
Were you there last night? 
Were you there last night? 
Were you there last night? 
Were you there last night? 


The questionnaire maker must depend on words alone. It is 
apparent that he cannot be too careful in phrasing questions to 
insure their clarity of purpose. While there are no certain ways 
of producing fool-proof questions, there are principles that might 
be employed to make items more precise. A few are suggested 
here, with the hope that students constructing questionnaires will 
become critical of their first efforts and strive to make each ques- 
tion as clear as possible, 


1. Define or qualify terms that could easily be misinterpreted. 


7 What is the value of your house? 
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The meaning of the term value is not clear. It could mean 
the assessed value for tax purposes, what it would sell for on the 
present market, what you would be willing to sell it for, what it 
would cost to replace, or what you paid for it. These values may 
differ considerably. It is essential to frame specific questions 
such as, "What is the present market-value of your house?" 

As simple a term as age is often misunderstood. When is an 
individual twenty-one? Most people would say that a person is 
twenty-one from the day of his twenty-first birthday until the 
day of his twenty-second. An insurance company would conside- 
him twenty-one from the twenty-year, six-months date until the 
twenty-first-year, six-months date. Perhaps this question could 
be clarified by asking age to nearest birthday, or date of birth. 

There are hundreds of words that are ambiguous because of 
their many interpretations. One has only to think of such words 
and phrases as curriculum, democracy, progressive education, co- 
operation, and integration—even such simple words as how much 
and now. To the question, “What work are you doing now?” the 
respondent might be tempted to answer, “Filling out your foolish 
questionnaire.” 

2. Be careful in using descriptive 
have no agreed-upon meaning. This fault is frequently found in 
rating scales as well as in questionnaires. Frequently, occasion- . 
ally, and rarely do not have the same meanings to different persons. 
One respondent's occasionally may be another's rarely. Perhaps a 
Stated frequency—times per week, times per month—would make 


this classification more precise. 
3. Beware of double negatives. 


adjectives and adverbs that 


Are you opposed to not requiring students to take showers after 


gym class? 1 k 
Federal aid should not be granted to thos’ puc in which edu- 
cation is not equal regardless of race, creed, or color. 


4. Be careful of inadequate alternatives. 


Married? Yes. ——— No ——— 3 
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Does this question refer to present or former marital status? 
How would the person answer who is widowed, separated or 
divorced? 


How late at night do you permit your children to watch television? 


There may be no established family policy. If there is a policy, 
it may differ for children of different ages, It may be different 
for school nights, or for F riday and Saturday nights when the late, 
late show may be permitted, 

5. Avoid the double-barreled question. 


Do you believe that gifted students should be placed in separate 
groups for instructional Purposes and assigned to special schools? 


One might agree on the advisability of separate groups for in- 
structional purposes, but be very much opposed to the assignment 
of -gifted students to special schools. Two questions are needed. 

6. Underline a word if you wish to indicate special emphasis, 


Should all schools offer a modern forzign language? 


7. When asking for ratings or comparisons a point of reference 
is necessary. 


How would you rate this student teacher's classroom teaching? 
Superior. 'Average Below Average 


With whom is the student teacher to be compared—an ex- 
perienced teacher, other student teachers, former student teachers 
—or should the criterion be what a student teacher is expected to 


be able to do? 
8. Avoid unwarrar.ted assumptions. 


Are you satisfied with the salary raise that you received last year? 


-A “no” answer might mean that I didn't get a raise, or that I 
did get a raise, but I'm not satisfied. 
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Do you feel that you benefitted from the spankings that you 
received as a child? 


A “no” response might mean that the spankings did not help 
me, or that my parents did not administer corporal punishment, 
These unwarranted assumptions are nearly as bad as the classic, 
"Have you stopped beating your wife?" 

9. Phrase questions so that they are appropriate for all re- 
spondents, 


What is your monthly teaching salary? 


Some teachers are paid on a nine-month basis, some ten, some 
eleven, and some twelve. Three questions would be needed. ^ 


Your salary per month? 
Number of months in school term? 
Number of salary payments per year? 


10. Design questions that.will give a complete response. 
Do you read the Indianapolis Star? Yes—— — — No. 


A "yes" or "no" answer would not reveal much information about 
the reading habits of the respondent. The question might be fol- 
lowed with an additional item, as in Fig. 7-1. 

ll. Provide for the systematic quantification of responses. „One 
type of question that asks respondents to check a number of items 
from a list is difficult to summarize, especially if all respondents 
do not check the same number. One solution is to ask respondents 
to rank, in order of preference, a specific number of responses. 
on programs? Rank in order of 


What are your favorite televisi ? 
Preference your first, second, third, fourth, and fifth choices. 


SE ightings. 
The items can then be tabulated by inverse weightings 
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If your answer is "Yes," kindly check how often 


and what sections of the Star you read. 


Section 


National and inter- 
national news 


Usually Seldom 


[ Never 


State and local news 


Editorial 


Sports pz 


Comic iL. 
Society 

Financial xs ji 
Advertising 

Want Ad | 


Syndicated features 


Special features 


Other (specify) 


lst Choice 
2nd Choice 
3rd Choice 
4th Choice 
5th Choice 


The relative popularity of the programs could be described for 
à group in terms of total weighted scores, the most popular having 


the largest total. 


12. Consider the possibility of classifying the responses yourself, 
rather than having the respondent choose categories. If a student 
were asked to classify his father's occupation in one of the following 
categories, the results might be quite unsatisfactory. 


Fig. 7-1. 


Unskilled labor 
Skilled labor 
Clerical work 
Managerial work 


Profession 


Proprietorship 


. -It is likely that by asking the child one or two short questions 


5 Points 
4 Points 


-3 Points 


2 Points 
l Point 


about his father's work, it could be classified more accurately. 
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1. At what place does your father work? 
2. What kind of work does he do? 


The student should bear in mind these few suggestions in con- 
Structing questionnaire items. "There is no recipe or set of easy 
directions. 1t is a difficult job, one that requires a great deal of 
hard work, imagination, and ingenuity. 


CHARACTERISTICS OF A GOOD QUESTIONNAIRE 


1. It deals with a significant topic, a topic the respondent will 
recognize as important enough to warrant spending his time in com- : 
pleting, The significance should be clearly and carefully stated on 
the questionnaire, or in the letter that accompanies it. 

2. It seeks only that information which cannot be obtained from 
other sources such as school reports or census data. 

3. It is as short as possible, only long enough to get the essential 
data, Long questionnaires frequently find their way into the waste- 
basket. o "S d 

4. It is attractive in appearance, neatly arranged, and clearly 


duplicated or printed. 

5. Directions are clear and complete, important terms are de- 
fined, each question deals with a single idea, all questions are 
worded as simply and as clearly as possible, and the categories 
provide an opportunity for easy, accurate, and unambiguous re- 
sponses, : 

6. The questions are object 
to the responses desired. Lea 
Priate on a questionnaire as they are in a court of law. 4 

7. Questions are presented in good psychological order, n 
ing from general to more specific responses. This order helps the 
respondent to organize his own thinking, se that his answers E 
logical and objective. It may be well to present questions 5 
create a favorable attitude before proceeding to those that pa 
a bit delicate or intimate. If possible, annoying or embarrassing 


questions should be avoided. 


ive, with no leading suggestions as 
ding questions are just "as inappro- 
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8. It is easy to tabulate and interpret. It is advisable to precon- 
: struct a tabulation sheet, anticipating how the data will be tabu- 
lated and interpreted, before the final form of the question is de- 
cided upon. This working backward from a visualization of the 
final analysis of data is an important step in avoiding ambiguity 
in questionnaire form. 
If mechanical tabulating equipment is to be used, it is important 
to allow code numbers for all possible responses to permit easy 
transference to machine-tabulation cards. 


PREPARING AND ADMINÍSTERING THE QUESTIONNAIRE 


1. Get all of the help that you can in planning and constructing 
your questionnaire, Study other questionnaires, and submit your 
items for criticism to other members of your class or your faculty, 
especially to those who have had experience in questionnaire con- 
struction. 

2. Try out your questionnaire on a few friends and acquaintances. 
When you do this personally, you may find that a number of your 
items are ambiguous. What may seem: perfectly clear to you may 
be confusing to a person who does not have the frame of reference 
that you gained from living with, and thinking about, an idea over 
a long period of time. 

This "dry-run" will be well worth the time and effort that it takes. 
It may reveal defects that can be corrected before the final form is 
printed and committed to the mails. Once the instrument has been 
sent out, it is too late to remedy its defects. 

3. Choose respondents carefully. It is important that question- 
naires be sent only to those who possess the desired information— 
those who are likely to be sufficiently interested to respond con- 
scientiously and objectively. A preliminary card, asking whether 
or not the individual would be willing to participate in the proposed 
study, is recommended by some research authorities. This is not 
only a courteous approach, but a practical way of discovering those 
who will cooperate in furnishing the desired information. 
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In a study on questionnaire returns See ! discovered that a greater 
proportion of returns was obtained when the original request was 
sent to the administrative head of an organization, rather than 
directly to the person who had the desired information. It is pos- 
sible that when a superior officer turns over a questionnaire to a 
staff member to fill out, there is implied some feeling of obliga- 
tion. 

4. If schedules or questionnaires are planned for use in a public 
school,'asking for the responses of teachers or pupils, it is essential 
that approval of the project be secured from the principal, who may 
then wish to secure approval from the superintendent of schools. 
Schools are understandably sensitive to public relations. One can 
understand the possibilities of unfavorable publicity that may result 
from certain types of studies made by individuals not officially desig- 
nated to conduct research. 

School officials may also want to prevent the exploitation of 
teachers and pupils by amateur researchers, whose activities would 
require an excessive amount of time and effort in activities not 
related to the purposes of the school.* 

5. If. the desired information is delicate or intimate in nature, 
Consider the possibility of providing for anonymous responses. 
The anonymous instrument is most likely to produce objective re- 
sponses, There are occasions, however, for purposes of classifica- 
tion, when the identity of the respondent is necessary. If a signa- 
ture is needed, it is essential to convince the respondent that D 
responses will be held in strict confidence, and that his answers will 
in no way jeopardize the status and security of his position. — 

6. Try to get the aid of sponsorship. Recipients are more likely 
to answer if a person, organization, or institution of prestige has 
endorsed the project. Of course, it is unethical: to claim sponsor- 
Ship unless it has been expressly given. 

7. Be sure to include a courteous, carefully constructed cover 
letter to explain the purpose of the study. The letter "E 
Promise some sort of inducement to the respondent for compliance 


1 Harold W. See, “Send It To The President,” Phi Delta Kappan, 88:4, Janu- 


ary, 1957, p. 130. 
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with the request. Commercial agencies furnish rewards in goods 
or money. In educational circles a summary of questionnaire re- 
sults is considered an appropriate reward, a promise that should be 
scrupulously honored after the study has been completed. 

The cover letter should assure the respondent that delicate infor- 
mation will be held in strict confidence. The explanation of spon- 
sorship might well be mentioned. Of course, a stamped, addressed 
return envelope should be included. To omit this courtesy would 
be practically to guarantee that many of the questionnaires would 
go into the wastebasket. It has been suggested that-two copies of 
the questionnaire be sent, one to be returned when completed, and 
the other for the respondent’s own file. 

8. Recipients are often slow to return completed questionnaires. 
To increase the number of returns, a vigorous follow-up procedure 
may be necessary. A courteous post card reminding the recipient 
that the completed questionnaire has not been received will bring 
in some additional responses. This reminder will be effective with 
those who have just put off or forgotten to fill out or mail the 
document. A further step in the follow-up process may involve a 
personal letter of reminder, In extreme cases a telegram, phone 
call, or personal visit may bring additional responses. 

It is difficult to estimate, in the abstract, what percentage of 
questionnaire responses is to be considered adequate or satisfactory. 
The importance of the project, the quality of the questionnaire, the 
care used in selecting recipients, the time of year, and many other 
factors may be significant in determining the proportion of re- 
sponses. Needless to say, the smaller the percentage of responses, 
the smaller the degree of confidence one may place in the adequacy 
of the data collected. Of course, objectivity of reporting requires 
that the proporticn of responses received should always be included 
in the research report. 

In concluding this part of the discussion it would be appropriate 
to recognize the important part that questionnaires play in educa- 
tional research. The American Association of Schoo! Administrators 
and the Research Division of the National Education Associa- 
tion publish an annual bibliography, Questionnaire Studies Com- 
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pleted. This report, published annually since 1930, provides edu- 
cators with an alphabetized list of topics covered and a short 
abstract of each study. These studies deal with all phases of educa- 
tion, including such topics as school finance, teaching methods, 
personnel, transportation, curriculum, and legal aspects. 


THE OPINIONNAIRE OR ATTITUDE SCALE 


The information form that attempts to obtain the measured atti- 
tude or belief of an individual is known as an opinionnaire or atti- 
tude scale. Since the terms opinion and attitude are not syn- 
onymous, a clarification is necessary. j 

How an individual feels, or what he believes, is his attitude. 
But it is difficult, if not impossible, to describe and measure atti- 
tude. The researcher must depend upon what the individual says 
as to his beliefs and feelings. This is the area of opinion. Through 
the use of questions, or by getting an individual's expressed reaction 
to statements, a sample of his opinion is obtained. From this state- 
ment of opinion may, be inferred or sestimated his attitude—what 
he really believes. 

The process of inferring attitude from expressed opinion has many 
limitations, An individual may conceal his real attitude, and ex- 
press socially acceptable opinions. An individual may not really 
know how he feels about a social issue. He may never have given 
the idea serious consideration. An individual may be unable to 
know his attitude about a situation in the abstract. Until con- 
fronted with a real situation, he may be unable to predict his reac- 
tion or behavior. 

Even behavior itself is not always a true indication of attitude. 
When politicians kiss babies, their behavior may not be a true 
expression of affection towards infants. Social custom or du desire 
for social approval make many overt expressions of behavior mere 
formalities, quite unrelated to the inward feelings of the individual. 


_? National Education Association, Research Division, e. AM mes 
ciation of School Administrators, Questionnaire Se T 2 bass 1958.) 
raphy No, 29, 1957-58 (Washington: The Association, Dees 
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Even though there is no sure method of describing and measuring 
attitude, the description and measurement of opinion, in many 
instances, may be closely related to the real feeling or attitude 
of an individual. 

With these limitations in mind, psychologists and sociologists have 
explored an interesting area of research, basing their data upon the 
expressed opinions of individuals. Several methods have been em- 
ployed: 

1. Asking the individual directly how he feels about a subject. 
This technique may employ a schedule or questionnaire of the open 
or closed form. It may employ the interview process, in which the 
‘respondent expresses his opinions orally. 

2. Asking the individual to check the statements in a list with 
which he is in agreement. 

3. Asking the individual to indicate his degree of agreement or 
disagreement with_a series of statements about a controversial sub- 
ject. 

4. Inferring his attitude from his reaction to projective devices, 
through which he may reveal his attitude unconsciously, (A pro- 
jective device is a data-gathering instrument which conceals its 
Purpose in such a way that the subject cannot guess how he. should 
respond to appear in his best light. Thus, his real characteristics 
are revealed. ) 

Two of these procedures have been used extensively in opinion 
research, and warrant a brief description. 


Thurstone technique 


The first is known as the Thurstone Technique of scaled values. 
A number of statements, usually twenty or more, that express vari- 
ous points of view towards a group, institution, idea, or practice are 
gathered. They are then submitted to a panel of fifty or more 
judges, who each arrange them in eleven groups, ranging from 


3L. L. Thurstone and E. J. Chave, The Measurement of Attitudes (Chi- 
cago: University of Chicago Press, 1929.) 
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one extreme to another in position. This sorting by each judge 
yields a composite position for each of the items. When there has 
been marked disagreement between the judges in assigning a posi- 
tion to an item, that item is discarded. For items that are retained, 
each is given'its median scale value, between one and eleven, as 
established by the panel. 

The list of statements is then given to the subjects, who are 
asked to check the statements with which they are in agreement. 
The median value of the statements that they check establishes 
their score, or quantifies their opinion. 


Lickert method 


The second method, the Lickert Method of Summated Ratings, 
Which can be carried out without the panel of judges, has yielded 
Scores very similar to those obtained by the Thurstone method. The 
coefficient of correlation between the scales was reported as high as 
+.92 in one study. Since the Lickert-type scale takes much less 
time to construct, it offers an interesting possibility for the student 
of opinion research. `° Dd oi’ 

The first step in constructing a Lickert-type scale consists of col- 
lecting a number of statements about a subject. The correctness 
of the statements is not important. If they express opinions held 
by a substantial number of people, they may be used. It is impor- 


tant that they express definite favorableness or unfavorableness 


to a particular point of view. The number of favorable and un- 


favorable statements should be approximately equal. 

After the statements have been gathered, a trial test should be 
administered to a number of subjects. Only those items that cor- 
Telate with the total test should be retained. This testing for 


internal consistency will help to elimmate statements that are 
the rest of the scale. 


ambiguous or that are not of the same type as t E 
58. 


A few statements from an opinionnaire appear on P. 
“ i f th 
*Alln L, Edwards and Katherine C. Kenney, P CAN Tum of 
Thurstone and Lickert Techniques of Attitude Scale Cons , 
Pplied Psychology, 30:72-83, February, ret 
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a 


INTERCULTURAL OPINIONNAIRE 


The following statements are presented as generalizations and represent 
opinions rather than facts. As opinions, they are neither right nor wrong, and 
your agreement or disagreement will be determined largely in terms of your 
particular experiences. Kindly check your position on the statement 4 it first 


impresses you. Indicate what you believe, rather than what you think you 
should believe. 


a. I agree with the statement. 

b. I am inclined to agree ( with reservations). 

c. I cannot say (have no feeling one way or another) 
(the evidence is insufficient). 

d. I am inclined to disagree (disagree with reservations). 

e. I disagree. 


1. The religious beliefs of an applicant should not be 
considered in selecting public-school teachers. 

2. Negro children should attend separate but equally 
good schools. 

8. No one should be barred from buying a home in a 
good residential area because of his race or religion. 

4. If Negroes were placed in,good homes in good resi- 
dential areas, the property would soon detériorate 
and become shabby. 


5. There is no reason why a Catholic should not be 
elected President of the United States. 


It is apparent that this technique could be used to measure 
opinion in many areas of controversy: the recognition of Red China 
by the United Nations, racial integration in the public schools, 
the teaching of religion in the public schools, federal aid to educa- 
tion, universal military training, right-to-work legislation, and many 
others. 

These scales may be analyzed in several ways. A simple way to 
describe but not measure opinion is to indicate the percentage 
responses on each item. Three out of four teachers agree that 
; 80 per cent of male teachers agree with the statement —— 
The actual Lickert scaling technique assigns each position a 


scale value. Starting with a point of view, all statements favoring 
this position would be scored: 
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Scale Value 
. Agree 
Tend to Agree 
. Cannot Say 
Tend to Disagree 
. Disagree 


o £0 cn» 
Lb OR Ut 


For statements opposing this position, the items would be scored 
in the opposite order 


Scale Value 
a. Agree 
b. Tend to Agree 
c. Cannot Say 
d. Tend to Disagree 
e. Disagree 
The test scores obtained on all of the items would then measure 
the respondent’s favorableness towards the given point of view. 
If the opinionnaire consisted of thirty statements or items, the 


following score values would be revealing: 


OU C 19 


30 x 5= 150 Most favorable response possible 
30x S8= 90 A neutral atttiude 
30x l= 30 Most unfavorable attitude 

The scores for any individual would fall between 30 and 150; 
above 90, if opinions tended to be favorable, and below 90, if opin- 
ions tended to be unfavorable to the given point of view. 

The author has used this device in a course which includes a unit 
dealing with intercultural relations. It is interesting to note 
whether information about minority groups tends to alter an indi- 
vidual’s attitude or opinion towards the group. Before the unit is 
begun, the students respond to a thirty-statement opinionnaire de- 
Vised by the author. The papers are filled out anonymously, and 
each student is instructed to mark his paper with some symbol 
known only to him, so that he can identify it at a later date. 

Upon the completion of the unit several weeks later, m end 
Tespond to another copy of the same opinionnaire, again mes ap 
it with the symbol previously used. After the papers are ae itud 
instructor has a device which indicates possible changes in diste 
°F, at least, in expressed opinions. Invariably, Dod has e 
sistent growth in favorableness towards minority groups. 
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the measure is crude, it does seem to support the hypothesis that 
knowledge about minority groups brings about a more favorable 
attitude towards them—in the classroom, at least. It is possible 
that the change in score is more significant than the magnitude of 
the score itself, for the validity of the instrument has not been, and 
cannot be, established. 

This example of opinion analysis demonstrates how a teacher may 
use this technique to create class interest, even though it may fail 
to achieve the rigorous standards of fundamental research pro- 
'zedures. 

It would be unwise to conclude this discussion without a recog- 
nition of the limitations of this type of opinion measurement. Obvi- 
ously, it is somewhat inexact, and fails to measure opinion with the 
precision that one would desire, 

There is no basis for belief that the five positions indicated on 
the scale are equally spaced. The interval between "tend to agree" 
and "agree" may not be equal to the interval between "tend to 
agree" and "cannot say." it is also unlikely that the statements 
are of equal value in "for-ness" Or “against-ness.” That the re- 
spondent can validly react to a short statement on a printed form, 
in the absence of real-life qualifying situations, is unlikely, That 
equal scores obtained by several individuals indicate equal favor- 
ableness towards the given position is unlikely. Actually, different 
combinations of positions can yield equal score values, without 
necessarily indicating equivalent positions of attitude or opinion. 
Even though the opinionnaire provides for anonymous response, 
there is a possibility that an individual may answer according to 
what he thinks that he should feel, rather than how he really feels. 

In spite of these limitations, the process of opinion measurement 
has merit, and until more precise measures of attitude are developed, 
this technique may serve a useful purpose in social research. 


OBSERVATION 


As a data-gathering device, direct observation may make an 
important contribution to descriptive research. Certain types of 
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information can best be obtained through direct examination by 
the researcher. When the information concerns aspects of material 
objects or specimens, the process is-relatively simple, and may con- 
sist of classifying, measuring, or counting. But when the process 
involves the study of a human subject in action, it is much more 
complex. 

One may study the characteristics of a school building by observ- 
ing and recording such aspects as materials of construction, number 
of rooms for various purposes, size of rooms, amount of furniture and 
equipment, presence or absence of certain facilities, and other = 
relevant aspects. Adequacy could then be determined by compar- 
ing these facilities with reasonable standards, previously determined 
by expert judgment and research. 

In university athletic departments observation has been used 
effectively to scout the performance of the teams that will be en- 
countered in interschool competition. Careful observation and 
recording of the skills and procedures of both team and individual 
players are made, and defenses and offenses are planned to. cope 
with them. What formations or patterns of attack or defense are 
employed? Who carried the ball? Who does the passing, and 
where and with what hand does he pass? Who are the likely 
receivers, and how do they pivot and cut? 

During a game a coaching assistant may sit high in the stands, 
relaying strategic observations by phone to the coach on the bench. 
At the same time, every minute of play is being recorded on film 
for careful study by the coaching staff and players. Who missed 
his tackle when that play went -through for twenty yards? Who 
Missed his block when play number two lost six yards? Careful 
Study of these films provides valuable data on weaknesses to be x: 
Tected before the following Saturday's game. Through the use o 
binoculars, the phone, the motion picture cam=ra, and the tape 
Tecorder, observations can be carefully made and recorded. ‘ 

While this example may seem inappropriate in a discussion 2 
observation as a research technique, improving the So à 
à football team is not altogether different from ge prob em P 
analyzing learnin g behavior in a classroom. The difference is on 
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of degree of complexity. The objectives of the football team are 
more concretely identifiable than the more complex purposes of 
the classroom. Yet, some of the procedures of observation, so 
effective in football coaching, may also be systematically employed 
in studying classroom performance. In some schools teachers make 
short periodic classroom or playground observations of pupil be- 
havior, which are filed in the cumulative folder. These recorded 
observations, known as anecdotal reports, may provide useful data 
for research studies. 
< The method of laboratory experimentation seeks to describe 
action or behavior that will take place under carefully arranged 
and controlled conditions. But many important aspects of human 
behavior cannot be profitably observed under the contrived con- 
ditions of the laboratory. The method of descriptive research seeks 
to describe behavior under less rigid controls, under more naturally 
occurring conditions. The behavior of children in a classroom 
situation cannot be effectively analyzed by observing their behavior 
in a laboratory. It is necéssary to observe»what they actually do 
in a real classroom. 

This does not suggest that observation is haphazard or unplanned. 
On the contrary, observation as a research technique must always 
be expert, directed by a specific purpose, systematic, carefully 
focused, and thoroughly recorded. Like other research procedures, 
it must be subject to the usual checks for accuracy, validity, and 
reliability. 

The observer must know just what to look for. He must be able 
to distinguish between the significant aspects of the situation and 
factors that have little or no importance to the investigation. Of 
course, objectivity is essential, and careful and accurate methods 
of measuring and recording are employed. The use of the check 
list, score card, or,some other type of inquiry form may help to 
objectify and systematize the process, 

The use of accurate instruments such as the scale, thermometer; 
stethoscope, audiometer, stop watch, light meter, binoculars, camera, 
tape recorder, and other devices often makes possible observations 
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that are more refined than mere sense observations. At times, the 
nature of an act may be more accurately analyzed when the action 
is slowed down, repeated, or re-examined. The use of the motion 
picture camera, time-lapse photography, or the tape recorder has 
facilitated the analysis of complex activities. 

Both reliability and validity of observation are improved when 
Observations are made at frequent intervals by the same observer, 
Or when several observers record their observations independently. 
Tt is often important to establish conditions so that activities may 
take place in as natural a setting as possible, and are not unduly» 
influenced by the presence of the observer or by his measuring or 
recording devices. 

Newspaper reporters have confessed to minor crimes, in order 
to get a true picture of existing prison conditions. Secret agents 
assume elaborate disguises and establish fictitious identities, in 
order to find out what really happens inside a conspiracy. Hidden 
cameras and a one-way screen were used by Gessell to make 
Significant observations of the behavior of infants. One-way win- 
dows have been used to observe the behavior of children in typical 
Sroup activities, so that observers could see and hear without being 
either seen or heard. 


Record, ing observations 


If it does not distract or create a barrier between observer and 
those Observed, simultaneous recording of observations is recom- 
mended. This practice minimizes the errors that result from 
faulty memory. There are other occasions when recording would 
More appropriately follow some time after observation. The re- 
Cording of observations should be done as soon as possible, while 
the details are still fresh in the mind of the observer. But many 
authorities agree that objectivity is more likely when the interpre- 
tation of the meaning of the behavior described is deferred until 
S later time, for simultaneous recording and interpretation often 


Mterfere with objectivity. 
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Systematizing data collection 


To aid in the recording of information gained through observa- 
tion, a number.of devices have been extensively used. Check 
lists, rating scales, score cards, and scaled specimens provide sys- 
tematic means of summarizing or quantifying data collected by 
observation or examination. 


Check list 


The check list, the simplest of the devices, consists of a pre- 
pared list of items. The presence or absence of the item may be 
indicated by checking yes or no, or the type or number of items 
may be indicated by inserting the appropriate word or number. 
This simple "laundry-list" type of device systematizes and facilitates 
the recording of observations, and helps to assure the consideration 
of the important aspects of the object or act observed. Readers 
are familiar with check lists prepared to help buyers purchase a 
used car, choose a home site, or buy an insurance policy, indicating 
characteristics or features that one should bear in mind before 
making a decision. 7 


Rating scale 
The rating scale involves qualitative description of a limited num- 


ber of aspects of a thing, or of traits of a person. The classifications 
may be set up in five to seven categories in such terms as: 


Superior Above Average ^ Average Fair Inferior 
Excellent Good, Average Below Average Poor 
Always Frequently Occasiorfally Rarely Never 


Another procedure establishes positions in terms of behavioral 
or situational descriptions. These statements may be much more 
specific, and enable the judge to identify more clearly the charac- 
teristic to be rated. Instead of deciding whether the individual's 
leadership qualities are superior or above average, it may be 
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easier to decide between "Always exerts a strong influence on his 
associates," and "Sometimes is able to move others to action." 

One of the problems in constructing a rating scale lies in the diffi- 
culty of conveying to the rater just what quality one wishes evalu- 
ated. It is likely that a brief behavioral statement is more objec- 
tive than an adjective that may have no universal meaning in the 
abstract. 

Rating scales have several limitations. In addition to the diffi- 
culty of clearly defining the trait or characteristic to be evaluated, 
the halo effect causes raters to carry qualitative judgment from one, 
aspect to another. Thus, there is a tendency to rate a person who 
has a pleasing personality high on other traits like intelligence or 
Professional interest. This halo effect is likely to appear when 
the rater is asked to rate many factors, on a number of which he 
has no evidence for judgment. This suggests the advisability of 
keeping at a minimum the number of characteristics to be rated. 

Another limitation of rating is the tendency of raters to be too 
generous. A number of studies have verified the tendency to 
rate 60 to 80 per cent of an ünselected group above average in 
all traits, Rating scales should carry the suggestion. that raters 
Omit the rating of characteristics that they have had no opportunity 
to observe. 


Score card 


The score card, similar in some respects to both the check list 
and the rating scale, usually provides for the appraisal of a relatively 
large number of aspects. In addition, the presence of each charac- 
teristic or aspect, or the rating assigned to each, has a predeter- 
Mined point value. Thus, the score-card rating may yield a total 
Weighted score that can be used in the evaluation of the object ob- 
Served. Score cards are frequently used in evaluating communities, 
building sites, schools, or textbooks. Accrediting SENSES an 
times use the score card in arriving at an over-all evaluation of a 
School. 


Score cards have been designed to help in estimating the socio- 
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economic status of a family. Such aspects as type of neighborhood, 
home (owned or rented), number of rooms, ownership of a piano, 
number of books in the library, number and type of periodicals 
subscribed to, telephone, occupation of father, and organizations 
parents belong to are all considered significant and have appropriate 
point values assigned. 

The limitations of the score card are similar to those of the rating 
scale. In addition to the difficulty of choosing, identifying, and 
quantifying the significant aspects of the factor to be observed, there 
is the suspicion that the whole of a thing may be greater than the 

“sum of its parts. 

Colleges and universities are frequently evaluated in terms of 
such elements as size of endowment, proportion of faculty members 
holding the earned doctoral degree, pupil-teacher ratio, and number 
of volumes in the library. While these aspects are important, the 
effectiveness of an institution may not be accurately appraised by 
their summation, for there are certain important intangibles that do 
not lend themselves to score card ratings. 


Scaled specimen 


The scaled specimen, although not frequently encountered, pro- 
vides an effective method for evaluating certain standards of per- 
formance. Thorndyke’s handwriting scales provide a number of 
graded samples to which one may compare the handwriting to be 
evaluated. Various intelligence test scoring manuals provide scaled 
specimens for determining the mental age of children as revealed 
by their drawings. 


Content or document analysis 


The systematic examination of records or documents is a special- 
ized application of data-gathering by observation. Since this 


process has been discussed in. some detail in the chapter on de- 


scriptive research (Chap. 5), it is not repeated here. 
Observation, as a research data-gathering process, demands rigor- 
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ous adherence to the spirit of scientific inquiry. The following 
standards should characterize the observer and his observations: 

1. Observation is carefully planned, systematic, and perceptive. - 
The observer knows what he is looking for, and what is irrelevant 
inasituation. He is not distracted by the dramatic or the spectacu- 
lar. 

2. The observer is aware of the wholeness of what is observed. 
While he is alert to significant details, he knows that the whole is 
often greater than the sum of its parts. 

3. The observer is objective. He recognizes his likely biases, 
and he strives to eliminate their influence upon what he sees and 
reports. 

4. The observer separates the facts from the interpretation of 
the facts. He observes the facts, and makes his interpretation at 
a later time. 

5. Observations are checked and verified, whenever possible, by 
repetition, or by comparison with those of other competent ob- 
servers, 

6. Observations aré carefully and ‘expertly recorded. The ob- 
server uses appropriate instruments to systematize, quantify, and 
preserve the results of his Gbservations. 


THE INTERVIEW * 


The interview is, in a sense, an oral type of questionnaire. In- 
Stead of writing the response, the subject or interviewee gives the 
needed information verbally in a face-to-face relationship. 

With a skillful interviewer, the interview is often superior to other 
data-gathering devices, One reason is that people are usually more 
willing to talk than to write. After the interviewer gains rapport, 
9r establishes a friendly, secure relationship with the subject, cer- 
tain types of confidential information may 5e obtained that an 
individual might be reluctant to put in writing. The interviewer 
can explain the purpose of his investigation, and can explain more 


‘ood 
ci See Pauline V. Young, Scientific Social Surveys and Research (Englew 
is, N. J.: Prentice-Hall, Inc., 1949), Chapter XI. 


168 THE TOOLS OF RESEARCH 


clearly just what information he wants. If the subject misinter- 
prets the question, the interviewer may follow it with a clarifying 
question. At the same time, he may evaluate the sincerity and 
insight of the interviewee. It is also possible to seek the same 
information, in several ways, at various stages of the interview, thus 
providing a check of the truthfulness of the responses. 

Through the interview technique the researcher may stimulate 
the subject to greater insight into his own experiences, and thereby 
explore significant areas not anticipated in the original plan of 
investigation. The interview is also particularly appropriate when 
dealing with young children, illiterates, those with language diffi- 

. culties, and those of limited intelligence. 

If one were to study what junior high school students like and 
dislike in teachers, some sort of written schedule would probably 
be satisfactory. In order to conduct a similar study with first-grade 
pupils, the interview would be the only feasible method of getting 
responses. 

(When a graduate student in the author's class carried on such 
à study, she was surprised and amused to discover that first-grade 
children frequently mentioned “she smells nice" as a favored char- 
acteristic of the teacher.) d 

The preparation for the interview is a critical step in the pro- 
cedure. The interviewer must have a clear conception of just what 
information he needs. He must clearly outline the best sequence 
of questions and stimulating comments that will systematically 
bring out the desired responses, A written outline, schedule, or 
check list will provide a set plan for the interview, precluding the 
possibility that the interviewer will fail to get important and 
needed data. 

The nature of the personal relationship between interviewer 
and subject requires an expertness and sensitivity that might well 
be called an art. Tke initial task of securing the confidence and 
cooperation of the subject is crucial. Talking in a friendly way 
about a topic of interest to the subject will often dispel hostility or 
suspicion and, before he realizes it, the subject is freely giving the 
desired information. As is true in the use of the questionnaire, the 
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interviewer must be able to assure the subject that his responses 
will be held in strict confidence. When interviews are not recorded 
by tape or other electronic device, it will be necessary for the inter- 
Viewer to take written notes, either during the interview or imme- 
diately thereafter. It is suggested that the actual wording of the 
responses be retained. It is advisable to make the interpretation 
later, separating this phase of analysis from the actual recording 
of responses. 

Recording interviews on tape is convenient and inexpensive, 
and obviates the necessity of writing during the interview. Writ- 
ing during an interview may be a distracting influence, both tô 
interviewer and to subject. Interviews recorded on tape may 
be replayed as often as necessary for complete and objective analysis 
atalatertime. In addition to the words, the tone of voice and emo- 
tional impact of the response is preserved by the tapes. 

As a data-gathering technique, the interview has unique advan- 
tages. In areas where human motivation as revealed in reasons 
for actions, feeling, and attitudes is concerned, the interview can 
be most effective. Ir? the hands of a’skillful interviewer, through 
interstimulation of himself and the subject, a depth of response is 
Possible, a penetration quite unlikely to be achieved through any 
other means. 

This technique is time-consuming, however, and one of the most 
difficult to employ successfully. The danger of interviewer bias is 
Constant. Since the objectivity, sensitivity, and insight of the inter- 
Viewer is crucial, this procedure is one that requires a level of ex- 
bertness not ordinarily possessed by inexperienced researchers. 


PSYCHOLOGICAL TESTS 


gical tests are among the most 
Since tkeir basic purpose is 
they provide the 


As data-gathering devices, psycholo 
useful tools of educational research. 
to describe and measure individual differences, 
necessary data from which improved principles and practices may 

e developed. 


i imited 
he short presentation of this section can examine only limite! 
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aspects of the nature of psychological testing. Students of educa- 
tional research should consult other volumes for a more complete 
discussion.® 

A psychological test is an instrument designed to describe and 
measure a sample of certain aspects of human behavior. Tests 
may be used to compare the behavior of two or more persons at a 
particular time, or one or more persons at different times. Psycho- 
logical tests yield objective and standardized descriptions of be- 
havior, quantified by numerical scores. Under ideal conditions, 
achievement or aptitude tests measure the best performance of 
which individuals are capable. Under ideal conditions, person- 
ality tests or inventories attempt to measure typical behavior. 
Tests are used to describe status (or a prevailing condition at a 
particular time), to measure changes in status produced by modify- 
ing factors, or to predict future behavior on the basis of present 
performance, 

In the simple classroom experiment described in the chapter on 
experimental research (Chap. 6), test scores were used to equate 
the experimental and control groups, to desc:ibe status in achieve- 
ment before the application of teaching methods, to measure pupil 
mean gain resulting from the application of experimental and con- 
trol teaching methods, and to evaluate the relative effectiveness of 
teaching methods. This example of classroom experimentation 
illustrates how experimental data may be gathered through the 
application of tests. 

In descriptive research studies tests are frequently used to de- 
scribe prevailing conditions at a particular time. How does a stu- 
dent compare with those of his own age or grade in school achieve- 
ment? How does a particular group compare with other groups 
in other schools, oz in other cities? 

In school surveys for the past forty years, achievement tests have 
been used extensively in the appraisal of instruction. Tests are 
frequently used in comparing the factors in a situation that seem 


8 Lee J. Cronbach, Essentials of Psychological Testing (New York: Harper & 
Brothers, 1949); and Anne Anastasi, Psychological Testing (New York: The 
Macmillan Co., 1954.) 
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to go together. When high scores in one trait are associated with 
high scores in another, and low scores in one are associated with 
low scores in another, we may look for possible cause-effect rela- 
tionships between the two linked factors. 

Because tests yield quantitative descriptions or measures, they 
make possible more precise analysis than can be achieved through 
subjective judgment alone. 

There are many ways of classifying psychological tests. One dis- 
tinction is made between performance tests and paper-and-pencil 
tests. Performance tests, usually administered individually, require 
that the subject manipulate objects or mechanical apparatus while 
his actions are observed and recorded by the examiner. Paper-and- 
pencil tests, usually administered in groups, require the subject to 
mark his responses on a prepared sheet. 

Two other opposing types are power versus timed, or speed, 
tests. Power tests have no time limit, and the subject attempts 
progressively more difficult tasks until he is unable to continue 

s successfully. Timed, or speed, tests usually involve the element of 
power, but in additior, limit the time that the subject has in which 
to complete certain tasks. 

Another distinction is that made between nonstandardized, 
teacher-made tests and standardized tests. The test that the class- 
room teacher constructs is likely to be less expertly designed than 
that of the professional, although it is based upon the best logic 
and skill that the teacher can command, and is usually “tailor-made 
for a particular gfoup of pupils. 

By contrast, the standardized test is designed for more general 
use, Each item has been subjected to careful analysis, total Sedem 
have been carefully analyzed, and validity and reliability Edom 
lished by careful statistical controls. Norms have been established, 
based upon the performance of many subjects of various ages pos 
in many different types of communities and geographic areas. Not 
Only has the content of the test been standardized, but the adminis- 
tration and scoring have also been set in one pattern so eae et 
subsequently taking the tests will take them under Me ane oe 
As far as possible, the interpretation has also been standarcizec 
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While it would be inaccurate to claim that all standardized tests 
meet optimum standards of excellence, these instruments have been 
made as sound as possible in the light of the best that is known 
by experts in test construction, administration, and interpretation. 

Psychological tests may also be classified in terms of their pur- 
poses—the types of psychological traits that they describe and 
measure. 


Achievement tests 


Tests of ability, or achievement tests, attempt to measure what 
an individual has learned—his present level of performance. Most 
tests used in schools are achievement tests. They are particularly 
helpful in determining individual or group status in academic learn- 
ing. Achievement test scores are used in placing, advancing, or 
retaining students at particular grade levels, They are used in 
diagnosing strengths and weaknesses, and as-a basis for awarding 
prizes, scholarships, or degrees. 

Frequently, achievement test scores are used in evaluating’ the 
influences of courses of study, tedchers, teaching methods, and 
other factors considered to be significant in educational practice. 
In using tests for evaluative purposes it is important not to gen- 
eralize beyond the specific elements measured, For example, to 
identify effective teaching exclusively with the limited products 
measured by the ordinary achievement test would be to define effec- 
tive teaching too narrowly. It is essential that researchers recog- 
nize that the elements of a situation under appraisal need to be 
evaluated on the basis of a number of criteria, not solely on a few 
limited aspects. 


Aptitude tests si 


: . T £ 
Aptitude tests attempt to predict the capacities d the degree o 
achievement that may be expected from individuals in a particular 
activity. To the extent that they measure past learning, they are 
similar to achievement tests, To the extent that they measure 
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nondeliberate or unplanned learnings, they are different. Aptitude 
tests attempt to predict an individual's capacity to acquire improved 
performance with additional training. 

Actually, capacity (or aptitude) cannot be measured directly. 
Aptitude can only be inferred on the basis of present performance, 
particularly in areas where there has been no deliberate attempt to 
teach the behaviors to be predicted. 

Intelligence, which is generally thought of as inborn potentiality, 
is really measured by present ability. Whether an individual's 
achievement is relatively high, average, or low, we assume that it is 
a measure of how effectively he has profited from his informal oppor- 
tunities for learning. To the extent that others have had similar 
Opportunities, we predict his capacity or potentiality on the basis 
of how his ability compares with that of others his own age. This 
is a matter of inference rather than direct measurement. Since it 
has proved useful in predicting future achievement, particularly 
in academic pursuits, we consider this concept of intelligence meas- 
urement a valid application. ° 

Aptitude tests have been similarly designed to predict improved 
Performance with further training in many areas. These inferred 
measurements have been applied to mechanical and manipulative 
skills, musical and artistic pursuits, and in many professional areas 
involving many types of predicted ability. 

In music, for example, ability to remember and discriminate be- 
tween differences in pitch, rhythm pattern, intensity, and timbre 
Seems to be closely related to future levels of development go 
musicianship. Present proficiency in these tasks provides a fair 
Predictive index of an individual's ability to profit from advanced 
instruction, particularly when the individual has had little formal 
training in music prior to the test. A 

Aptitude tests may be used to divide students into relatively 
homogeneous groups for instructional purposes, to identify students 
for scholarship grants, td screen individuals for particular educa- 
tional programs, or to help guide individuals into areas where 


they are most likely to succeed. 
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Interest 


Interest tests or inventories attempt to yield a measure of the 
types of activities that an individual has a tendency to like and 
to choose. One kind of test has compared the subjects pattern 
of interest to the interest patterns of successful practitioners in a 
-number of vocational fields. A distinctive pattern has been discov- 
ered to be characteristic of each field. The assumption is made that 
an individual is happiest and most successful working in a field most 

o like his own measured pattern of interests. 

Another test is based on the correlation between a number of 
activities from the areas of school, recreation, and work. These 
related activities have been identified by careful analysis with 
mechanical, computational, scientific, persuasive, artistic, literary, 
musical, social-service, and clerical areas of interest. By sorting 
the subject's stated likes and dislikes into various interest areas, 
a percentile score for each area is obtained. It is then assumed 
that the subject will find his area of greatest interest where his 
percentile scores are relatively high. 

Interest blanks or inventories are examples of self-report instru- 
ments in which the individual notes his own likes and dislikes. 
These self-report instruments are really standardized interviews 
in which the subject, through introspection, indicates feelings that 
may be interpreted in terms of what is known about interest pat- 
terns. 


Personality measures 


The so-called personality scales follow much the same self-report 
pattern. The individual checks responses to certain questions oF 
statements. These instruments yield scores which are assumed to 
measure certain personality traits or tendencies. To the extent that 
they have been carefully standardized and, yield quantitative scores 
they may be considered tests. But they have many of the character- 
istics of questionnaires or self-rating scales. 

Because of the difficulty, inability, or unwillingness of individ- 


D 
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uals to report their own reactions accurately or objectively, these 
instruments are of limited value. Part of this limitation may be due 
to the inadequate theories of personality upon which these tests 
have been based. At best, they provide useful data upon which 
to suggest the need for further analysis. Some ‘have reasonable 
empirical validity with particular groups of individuals, but prove 
to be inadequate when applied to others. For example, one per- 
sonality inventory has proven valuable in yielding scores that 
correlate highly with the diagnosis of psychiatrists in clinical situ- 
ations. But when applied to college students, its diagnostic value 
has proved disappointing.’ 

The development of instruments of personality description and 
measurement is relatively recent, and it is likely that continued 
research in this important area will yield better theories of person- 
ality and better instruments for describing and measuring its various 
aspects. 

The Mooney Problems Check List § is an inventory to be used by a 
student in reporting his own problems of adjustment. The subject 
is asked to indicate on the check list the problems that trouble him. 
From a list of these items, classified into different categories, a 
Picture of the student's problems, from his own viewpoint, is drawn. 
While the most useful interpretation may result from an item analy- 
sis of personal problems, the device does yield a quantitative score 
which may indicate the degree of difficulty that a student feels 
that he is experiencing in his adjustment. This instrument has been 
used as a research device to identify and describe the nature of 
the problems facing individuals and groups of individuals in a 
School. 

The tendency to withhold embarrassing responses and to express 
those that are socially acceptable; the emotional involvement of 
àn individual with his own problems; and lack of insight—all these 
limit the effectiveness of personal and sociai-adjustment scales. 
Some psychologists believe that the projective type of test offers 


T Cronbach, o; 
, Op. cit., p. 320. : 
OJ * Ross L. Mooney, Problem Check List, High Schoot 
io. Bureau of Educational Research, Ohio State University, 


School Form (Columbus, 
1941.) 
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greater promise, for these attempt to disguise their purpose so com- 
pletely that the subject is unable to know how to appear in the 
best light. 

The most commonly used projective tests involve the subjects 
interpretation of the meaning of various standardized ink-blot fig- 
ures or pictured situations. 


QUALITIES OF A GOOD TEST 


In selecting tests for research purposes, several qualities are de- 


" sirable. 


Validity 


In general, a test is valid if it measures what it claims to measure. 
However, validity may be defined in a number of ways: Logical 
validity means that the test actually measures or is specifically 
related to the trait(s) for which it was designed. But the test name 
is no measure of logical vàlidity.. Some tvsts of skill in English 
usage consist of identifying errors of punctuation, spelling, agree 
ment, and capitalization on a multiple-choice basis. While items of 
this type are relatively easy to construct, they tend to overemphasize 
certain phases of good usage, and have a very limited relationship 
to real skill in usage or the purposes of a good course in composition. 

Empirical validity is concerned with the usefulness of a test in 
predicting successful performance, or how well it accomplishes à 
practical purpose. If a test is designed to pick out good candidates 
for appointment as shop foremen, and test scores show a high posi 
tive correlation with actual success on the job, the test has a high 
degree of empirical validity, whatever factors it actually measures: 
It predicts well. It serves a useful purpose. 

But before a tes: can be evaluated on the basis of empirical 
validity, success on the job must be accurately described and meas- 
ured. The criteria of the production of the department, the judg- 
ment of supervisors, or measures of employee morale might serv? 
as evidence. Since these criteria might not be entirely satisfac- 
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tory, however, empirical validity is not easy to assess. It is often 
difficult to discover whether the faults of prediction lie in the test, 
in the criteria of success, or in both. Many so-called intelligence 
tests have a high degree of empirical validity. While there is great 
difference of opinion about the nature of intelligence, these tests 
have proved quite effective in predicting academic success. Per- 
haps they would be more appropriately labeled academic-aptitude 
tests. They do predict well. They serve a useful purpose. 

Tests are often validated by comparing their results with a test 
of known validity. A well-known scale of personal adjustment 
involved sorting nearly five-hundred cards into three categories, 
yes, no, and cannot say. The test equipment was expensive, and 
it could not be easily administered to large groups at the same 
time. A paper-and-pencil form was devised, using the simple 
process of checking responses to printed items on a test form. 
This form could be administered to a large group at one time and 
then scored by machine, all with little expense. The results were 
So similar to the more time-consuming, expensive card-sorting 
Process, that the latter has been largely replaced. This is an ex- 
ample of validation by comparing tests; in this case, by comparing 
an expensive, individual test with an easy-to-administer, group test. 

In like manner, performance tests have been validated against 
Paper-and-pencil tests, and short tests against longer tests. Through 
this process, more convenient and more appropriate tests can be 
devised to accomplish the measurement of behavior more effectively. 

There are other aspects of validity, perhaps beyond the scope of 
this discussion. The reader is urged to consult the volumes on 
Psychological testing cited at the beginning of this section. 


Reliability 


This quality suggests that a test measures accurately tia 
sistently, from one time to another. In tests Dos id d d 
efficient of reliability, errors of measure t have been re! a : 
to a minimum, Reliable tests, whatever 
Parable scores upon repeated administration. 


men 
they measure, yield 
An unreliable test 
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would be comparable to a stretchable rubber yardstick that yielded 
different measurements each time it was applied. 


Objectivity 


A test should yield a clear score value for each performance, the 
score being independent of the personal judgment of the scorer. 


Economy 


^ Tests that can be given in a short period of time are likely to 
gain the cooperation of the subject, and to conserve the time of all 
those involved in test administration. The matter of expense of 
administering a test is often a significant factor, if the testing pro- 
gram is being operated on a limited budget. 


Simplicity of administration, scoring, and interpretation 


Ease of administration, scoring, and interpretation is an impor- 
tant factor in selecting a test, particularly when expert personnel or 
an adequate budget are not available., Many good tests are easily 
and effectively administered, scored, and interpreted by the class- 
room teacher, who may not be an expert. 


Interest 


Tests that are interesting and enjoyable help to gain the coopera- 
tion of the subject. Those that are dull or seem silly may dis- 
courage or antagonize the subject. Under these unfavorable con- 
ditions, the test is not likely to yield useful results. 

It is important in selecting a test to recognize the fact that a good 
test does not necessarily possess all of the desirable qualities for all 
subjects or for all levels of performance. Within a certain range 
of age, maturity, or ability, a test may be suitable. For other indi- 
viduals outside that range, the test may be quite unsatisfactory and 
a more appropriate one needed. 
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The selection should be made after careful examination of the 
standardizing data contained in the test manual and extensive 
analysis of published evaluations of the instrument. Research 
workers should select the most appropriate standardized tests 
available. Detailed reports of their usefulness and limitations are 
usually supplied in the manual furnished by the publisher. The 
considered judgments of outside experts are also available. The 
Fourth Mental Measurements Yearbook, the best single reference 
on psychological tests, contains many critical evaluations of pub- 
lished tests, each contributed by an expert in the field of psycho- 
logical measurement. Usually, several different evaluations are 
included for each test. 

Since the reports are not duplicated from one volume to another, 
it is advisable to consult the 1940 Yearbook !'? and the Third Year- 
book! for additional reports not included in the current volume. 
In addition to the reviews and evaluations, the names of test pub- 
lishers, prices, forms, and appropriate uses are included. Readers 
are also urged to consult the listings and reviews of newly published 
psychological tests in such journals as Educational and Psychological 
Measurement, Psychological Abstracts, and the February issues of 
the Review of Educational Research for 1953, 1956, and 1959. 

In using psychological tests in educational research, it is im- 
portant to recognize the fact that standardized test scores are only 
approximate measures of the traits under consideration. This 
limitation is inevitable, and may be ascribed to a number of pos- 


sible factors: 
l. The choice of an inappropriate test for 


in mind, 
2. Errors inherent in any psychological test. No test is com- 


pletely valid or reliable. 


the specific purpose 


P; Mcr K. Buros, ed., Fourth Mental Measurements Yearbook (Highland 

ark, N. J.: The Gryphon Press, 1958.) ] 

P à Oscar K. a eU Td Thé 1940 Mental Measurements Yearbook (Highland 
ark, N. J.: The Grypl jn Press, 1940.) b 
H Oscar K, um e The Third. Mental Measurements Yearbook (New 
Tunswick, N. J.; Rutgers University Press, 194 
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3. Errors that result from poor test conditions, inexpert or care- 
less administration or scoring of the test, or faulty tabulation of 
test scores. 

4. Inexpert interpretation of test results. 


SOCIOMETRY 


Sociometry is a technique for describing social relationships that 
exist between individuals in a group. In an indirect way it 
attempts to describe attractions or repulsions between individuals, 
by asking them to indicate whom they would choose or reject in 
várious situations. Children in a school classroom may be asked 
to name the child, or several children in order of preference, that 
they would invite to a party, eat lunch with, sit next to, work with 
on a class project, or have as a friend. 

The United States Air Force has used sociometry to study the 

. acceptance of leadership in various situations. For example, the 
following question was used in a sociometric study of bomber 
crews: "What member of the crew, disregarding rank, would you 
select as the most effective leader, if your plane were forced down 
in a remote and primitive area?" 

In some sociometric studies, negatively phrased items have been 
used. If you were to work on a class project with another student, 
who would you not want to work with? Sociometric studies have 3 
been made of many types of social groups, including classroom | 
groups, fraternities and sororities, camp groups, factory and office . 
groups, navy squadrons, air force crews, and entire communities. è 


Jhe sociogram i 


2 Sociometric choices are represented graphically on a chart known | 
as a sociogram. There are many variations of pattern, and the 
reader is urged to consult specialized references on sociometry-”” 
A few observations will illustrate the nature of the sociogram. 

In constructing a sociogram, boys may be represented by triangles 


12 How to Construct a Sociogram. Horace Mann-Lincoln Institute of School i 
Experimentation (New York: Bureau of Publications, Teachers College, Colum- 
bia University, 1947) and J. L. Moreno, Who Shall Survive? 2nd rev. ed. (New 
York: Beacon House, 1953.) 
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and girls by circles. A choice may be represented by a single- 
pointed arrow, a mutual choice by an arrow pointing in opposite 
directions. Rejections may be represented by dotted lines. Those 
chosen most often are referred to as stars, those not chosen by 
others as isolates. Small groups made up of individuals who choose 
one another are cliques. 

The identifying initials of individuals are placed within the 
symbols. Symbols of those chosen most often are placed nearest 
the center of the diagram, with those chosen less often progressively 
Outward. Those not chosen are, literally, on the outside, (See 
Fig. 7-2.) It must be remembered that the relationship between 


first choice | ———— — —»* boy WX 


Second choice -—————-— > girl © 
mutual choice 4—4 
in a third grade 


Fi H 
!g. 7-2 Sociogram showing first and second choices ' 
class. 
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individuals in a group is a changeable thing. Children's choices 
are most temporary, for stability tends to develop only with age. 

Students of group relationships and classroom teachers may con- 
struct a number of sociograms over a period of time to measure 
changes that may have resulted from efforts to bring isolates into 
closer group relationships, or to transform cliques into more general 
group membership. The effectiveness of socializing or status- 
building procedures can thus be measured by the changes revealed 
in the sociogram. Since sociometry is a peer rating, rather than a 
rating by superiors, it adds another dimension to the understanding 
of members of a group. 


"GUESS-WHO" TECHNIQUE 


A process of description, closely related to sociometry, is the 
"guess-who" technique. Developed by Hartshorne and May;?? the 
process consists of description of the various roles played by children 
in a group. 

Children are asked to name the individuals who fit certain verbal 
descriptions. 


This one is always happy. 

This one is always picking on others. 
This one is always worried. 

This one never likes to do anything. 
This one will always help you. 


Items of this type yield interesting and significant peer judg- 
ments, and are useful in the study of individual roles. Of course; 
the names of children chosen should not be revealed. 


SOCIAL-DISTANCE SCALE 


Another approach to the description and measurement of ‘social 
relationships is the social-distance scale, developed by E. s. 


13 Hugh Hartshorne and Mark A. May, Studies in Service and Self-Contra 
(New York: The Macmillan Co., 1929.) 


= 
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Bogardus 1 at the University of Southern California. This device 
attempts to measure to what degree an individual, or a group of 
individuals, is accepted or rejected by another individual or the 
group. 

Various scaled situations, with score values ranging from accept- 
ance to rejection, are established. The individual checks his posi- 
gon by choosing one of the points on the scale. For example, in 
judging acceptance of a minority group, the choices might range 
between these extremes: 

I wouldn't object to having a member of this 

group become a member of my family by mar- 

riage. 

I wouldn’t mind sitting next to a member of 

, this group on a bus. 

Rejection I don't think that members of this group should 
be admitted into our country. 

When applied to an individual in a classroom situation, the 
choices might range, between these extremes: 


Complete acceptance Td like to have him as my best friend. 
Partial acceptance I^wouldn't mind sitting near him. 
Rejection I wish he weren't in my room. 

Of course, in the real social-distance scale, illustrated by the 
sample items above, there would be a larger number of evenly 
Spaced scaled positions (usually seven in number), giving a more 
Precise measure of acceptance or rejection. 

Devices of the type described here have 
the description and measurement of social rel 
this important area of social research, may yield 
useful data. 


Complete acceptance 


Partial acceptance 


many possibilities for 
ationships and, in 
interesting and 


SUMMARY 


e instruments that provide for the 


The tools th 
of research are s 
Collection of data upon which hypotheses may be tested. From 
h, 
XVI E. S. Bogardus, “A Social Distance Scale,” Sociology and Social Resear’ 
II, January-February, 1933, pp. 265-271. 
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the great variety of these tools the researcher chooses those which 
are most appropriate to the sources of data, and which provide the 
kinds and forms of information that would be most useful. The 
quantification of these data makes possible more precise analysis and 
interpretation. J 

A list of the data-gathering devices that have proven useful in 
educational research should include: schedules, questionnaires, 
opinionnaires, observation, check lists, rating scales, score cards, 
scaled specimens, document or content analysis, interviews, psycho- 
logical tests and inventories, sociograms, “guess-who” techniques, 
and social-distance scales. Each of these tools of research has been 
described. 

Some research investigations use but one of these devices, Others 
employ a number of them in combination. The student of educa- 
tional research should make an effort to familiarize himself with 
the strengths and limitations of these tools, and should attempt to 
develop skill in constructing and using them effectively. 

5 2 
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IN CHAPTER 1 THE NATURE OF 
was briefly described. ]t was poin 


Process do not always follow the same 


likely that some sort of hypothesis precedes’ the collection © 
liminary hypothesis may be modified in 


` S also likely that the pre 
e light of data that are gathered early in the research process: 
fa It is through these forward and backward movements in the 
rmulation of hypotheses, gathering data, and revising hunches 
187 


188 INTERPRETATION OF DATA 


that the imaginative researcher finally devises his proposition for 
ultimate testing. With this explanation in mind it is appropriate 
to review the essential phases of the research process: 


1. Identification of the problem. 

2. Formulation of the hypothesis or the hypotheses, in which the re- 
searcher entertains one or several tentative propositions. 

3. The collection of data. 

4. The analysis or classification and tabulation of data, in which the 
researcher applies the process of deduction. 

5. The synthesis of data, or the formulation of generalizations or prin- 
ciples that may substantiate or refute the hypothesis or hypotheses. 
This is the inductive phase of interpretation. 


This chapter deals with Steps 4 and 5, which explain the processes 
of analysis and synthesis of the data that have been gathered. 
In this phase of the research Process data are organized, classified, 
and examined for their meaning. 


QUANTIFICATION AND DESCRIPTION 


People and things may be described in qualitative terms, based 
upon the presence or absence of some quality or characteristic. 
Hair color, race, nationality, and sex are qualitative elements, and 
may be expressed in frequency or rank order of appearance, in 
fractions, or in percentages of the whole, Quantitative character- 
istics are described in terms of magnitude or amount of the factor 
present in a situation, Weight, size, cost, or amount are quan- 
titative descriptions, Qualitative measures may answer the ques- 
tion, how many? Quantitative Ineasures answer the question, how 
much? Both kinds of description are important in research, and 
make up the body of data. 2 

When comparing elements in a situation that are not equal in 
number, it is advisable to find a basis for comparison. Changing 
frequency counts into percentages is one method. Ranking in orde! 
of frequency, size, or degree of attainment in progress toward some 
established standard is another useful and valid basis. When dat? 


f 
B 
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are arranged in rank order, weightings may be used. A first rank 
is worth more than a second, a second more than a third, etc. For 
example, if five items are to be scored, it is customary to assign 
weightings as follows: 5 


Istess 5 Points 


2nd 4 Points 
8rd 3 Points 
4th 2 Points 
5th 1 Point 


Using this inverse system of weightings, preferences or other 
types of data to be ranked may be quantitatively handled, with total 
Weighted yalues describing composite positions. 


CLASSIFICATION 


4 When analyzing the characteristics or responses of a large group, 
it is often satisfactory to describe the group as a whole. In simple 
types of analysis: where the group described is sufficiently homo- 
Eeneous, no breakdown into subgroups is necessary. 

But in many situations the picture of the whole group is not 
Clear. There are too many differences within the group that tend 
to blur the picture and make meaningful description difficult. In 
Such cases it may be helpful to separate the group into categories, 
Or classes, that have in common some distinctive characteristic, that 
may be significant for the purposes of the analysis. These more 

©mogeneous groups display characteristics that may point up cer- 
tain generalizations. They may even lead to conclusions of cause- 
effect relationship. This process of classification into distinctive 


Categories underlies all science. AG- X. 
It should be remembered, however, that a category is distinctive 
nly when it js regarded in a certain way, or for a certain jena 
ailure to recognize this fact may easily lead to oversimplification. 


Man : ‘o ation of data into dichotomous, 
y stud: sification of da 
ies employ the clas d eden ee 


or two. f ° 
-fold, categories. Such categories as me 

2 Eirls, married or unmarried, white or Negro, uei p 

ndary, urban or rural, good teachers or poor teachers, an 2 
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graduates or high school graduates are frequently used to seek 
aspects prominent in one group but lacking in the other. Such 
a list could be extended indefinitely, limited only by the purposes 
of the investigation and the nature of the-data. 

When categories are established on the basis of test scores, rank- 
ings, or some other quantitative measure, it is advisable to compare 
those at the top with those at the bottom, omitting those near the 
middle of the distribution from the comparison. It is common to 
compare the top 25 per cent with the bottom 25 per cent, or the 
‘top 10 per cent with the bottom 10 per cent. Those cases that fall 
just above and below the midpoint tend to cancel out any sig- 
nificant differences that might exist. By eliminating the middle 
section, sharper contrast is achieved. 

Comparisons are not always dichotomous. At times it is de 
sirable to divide the large group into a number of categories. The 
number of classes will be determined by the number of different 
significant characteristics that can be identified by the researche^ 
and by his skill in handling the complex ‘relationships that such 
classifications make possible. 

Outside criteria for comparison. In addition to the comparisons 
that may be made between subgroups, or within the larger groUP' 
the whole group, or the subgroups, may be analyzed in terms V. 
some outside criteria. Of course, it must be assumed that vali 
and reliable measuring devices are available for making such com- 
parisons. These “measuring sticks” may consist of standardize 
tests, score cards, rating scales, frequency counts, and physical 3° 
well as psychological measuring devices. Some of these outs! É 
criteria are: " 

1. Prevailing conditions, practices, or performance of a differe? 
but comparable unit, or comparable units. This comparison ny 
be made with another community or other communities, school a 
schools, and class or classes. Comparisons may be made NE A 
groups representing best conditions or practices, typical or avers 
status, or equated groups that have been matched in terms 9 
tain variables, leaving one or a limited number of variables for € 
parison. 


[tud 
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ai What experts believe to constitute:best conditions or practices. 
E Ed may comprise a specially selected panel, chosen for | 
m. pose. A group of practitioners in the field who are assumed 

e most familiar with the characteristics under consideration, or 
the survey staff itself, may constitute the body of experts. The 
judgments of recognized authorities who publish their opinions are 
frequently selected as criteria. 

3. What a professional group, a commission, an accrediting 
peer! , or another scholarly deliberative body establishes as appro- 
priate standards. These standards may be expressed as lists of 
Objectives, or may be quantitative measures of status for accreditation 
or approval The American Medical Association's standards for 


* accreditation of medical schools, the North Central Association of 


Secondary Schools and Colleges’ accreditation standards, or the 
standards of the National Commission on Teacher Education and 
Professional Standards for programs of teacher education are ex- 


amples of evaluative criteria. 


4. Laws or rules that have been enacted or promulgated by a 


legislative or quasi-legislative body. The areas of teacher certifica- 
ds, or health and safety 


tion regulations, school building standar 
regulations provide appropriate criteria for comparison. 

5. Research evidence. The factors to be analyzed may be ex- 
amined in the light of principles confirmed by scholarly research 
that has been published and generally accepted. 

6. Public opinion. While not always appropriate as a criterion 
of what should be, the opinions or views of "the man on the street" 
are sometimes appropriate as a basis for comparison. 


SORTING AND TABULATING DATA 

ata from the data- 
r form in which they may be sys- 
y be performed in a number 


Tabulation is the process of transferring d 


gathering instruments to the tabula 
tematically examined. This process ma 

of ways. In simple types of research hand-tabulating procedures 
are usually employed. In more extensive investigations @ card- 
tabulating process may be used, possibly using machine methods 
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for sorting and analyzing the data after it has been placed on the 
Saas tabulation. Advanced graduate students RET 
search studies at the doctoral level sometimes use mechanica 
methods for the tabulation and analysis of data. Through the GEE 
of cards upon which the research data are entered by perforation 
on a punching machine, great amounts of data may be systematized. 
When run through the tabulating machine, which may be set up 
to drop the cards in appropriate pockets according to the combina- 
tions of data desired, as many as a thousand cards per minute may 
be sorted. This type of tabulating equipment is produced by many 
business machines corporations, 
Since these machines must be operated by technically trained 
personnel, departments of research in large universities often pro- 
vide these services, with the student paying the costs of equipment 


and labor involved, In most of the larger cities these services may 
be obtained through commercial agencies, 

Edge-punched cards, Withou 
equipment, ed 
Data are trans 
edges of the 
the cards of 


ies employ the method of hand-sorting 
ions written on tabulation sheets. To 
er accuracy, it is recommended that one 
the other records them on the tabula- 
recorded by fence tallies, with a cross 
In constructing tally form sheets it is impor- 
Space to record the tallies in each category: 
sion on hand tabulation emphasizes the im- 
nning before the sorting and tabulation begin: 
bulation. Without careful planning an inex- 


and recording, with tabulat 
save time and to insure great 
person read the data while 
tion sheet. Marks are best 
line every five tallies. 


portance of careful pla: 


Sorting and hand ta 
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perienced reseacher may tabulate responses on a set of question- 
V filled out by a group of teachers. After completing the tabu- 
ation, he may decide to compare the responses of elementary 


teachers with secondary teachers. This would involve retabulating: 


the responses of the questionnaires, It might then occur to him 
that it would be interesting to compare the responses of the men 
With those of the women. Another handling of the questionnaires 
would be necessary. 

If he had decided upon his categories before tabulation, one 
handling of the questionnaires would have been sufficient. Sorting 
the questionnaires into two piles, one for elementary teachers and 
another for secondary teachers, then sorting each of these into sep- 
arate piles for men and for women, would have yielded four 
Stacks. Then by tabulating the responses of each of the piles 
Separately, one planned operation would have yielded the same 
amount of information as three unplanned operations. 

Before tabulating questionnaires or opinionnaires, it is always 


important to decide upon the categories that are to be established - 


for analysis, It has been shown that if this decision is delayed, 
— may be necessary to retabulate the items a number of times, need- 
lessly consuming a great deal of time and effort. 
Let us assume that we are analyzing a yes-no response on a ques- 
tionnaire distributed in six colleges of a university to both men and 
Women members of the freshman, sophomore, junior, and senior 


Classes. One question might be: 
Question 1. I saw unauthorized notes and materials used in a final 
examination last semester. 

Youu == INO. 


The proper steps in tabulating the responses would be: 


piles, one for each college 


l. Sort the questionnaires into six 1 
Liberal Arts, Music, Phar- 


Business Administration, Education, 
Bo and Religion). 
pt each of the six piles into four cla 
en, sophomores, juniors, and seniors. 


ss piles, one each for 
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3. Sort each of the class piles by sex. 


"There are now forty-eight separate piles, which can be tabulated 
by yes or no response. Actually, the ninety-six possible combina- 
tions of responses can be tabulated, after sorting, 


in one handling 
of the questionnaires. 


"Totals for any subclassification can easily be 
obtained by simple addition (e.g. all freshmen in all colleges: all 
in the College of Pharmacy: all women in Liberal Arts, etc.). 
One tabulation sheet could be used for the recording of responses 
for this item, illustrated by Figure 8-1, 


- 
L. Arts] Music 


Pharmacy|Religion 
[eye 


aI 
See IE allt 
Fig. 8-1. Tabulation form providing for the analysis of 96 possible 
responses for question |. 
If the data-gathering device called for a larger number of re- 
sponses, 


the system of presorting 
advisable, however, to set up a se 
of the six colleges, because 
unwieldy, 


would be similar. It would be 
parate tabulation sheet for each 


a single tabulation sheet would become 


Figure 8-2 demonstrates how a five- 
could be tabulated for a question such a 
1. An honor System would eliminate ch 

I agree 

I tend to agree 

I cannot say 


I tend to disagree / 
Ux SC NEP 
I disagree 


item opinionnaire response 
s the following: 


eating in examinations, 


——" 


iEn. x 7 
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Students may apply these procedures to classify and tabulate 
similar types of data. These data sheets are not ordinarily pre- 
sented in the report, but they may suggest ways in which some of 
the data may be presented as tables or graphic figures. 


TABLES AND FIGURES 


The process of tabulation which has just been described is a first 
step in the construction of the tables that are included in a research 
report. It is likely that the beginning researcher thinks of tables 
purely as aids to reader understanding. They may serve an even® 
more important purpose in helping the researcher to see the similari- 
ties and relationships of his data in bold relief, as placed in rows 
and columns according to some logical plan of classification. 

A. discussion of the construction and use of tables and figures is 
presented in some detail in Chapter 10. 


STATISTICS 
. 


Research depends upon statistics, When descriptions are quan- 
tified, they can be analyzed more precisely. The processes of 


College of Liberal Arts 


end To 
Disagree 


Tac imme T 


e 
Tabulation form providing for the analysis of 40 possible 
based upon responses for question | on an opinionnaire. 


Fig. 8-2. 


categories 
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counting, measuring, comparing, and differentiating are involved 
in analysis. The competent researcher must be familiar with basic 
statistical procedures, and must know their limitations as well as 
areas of their appropriate application. 


Chapter 9 presents some simple statistical operations involved in 
the analysis of data, 


Limitations and sources of error 


Under the assumption that a suitable 
are established, valid and reliable data: 
employed, and that the procedures of dat: 
and skillfully executed, good data shoul 
for the purposes of the investigation, 

While good data are a necessary ingredient in a successful study, 
the effectiveness of analysis and interpretation will determine the 


worth of the project. Good data, poorly handled, will inevitably 
result in an inadequate study, 


What are some of the 
analysis and interpretation 
cess of an investigation? 

l. Confusing statements with facts. 
ceptance of statements as facts. What individuals report may be a 
sincere expression of what they believe to be the facts in a case, 
but these are not necessarily true, Few people observe skillfully, 
and many forget quickly. It is the researcher's responsibility to 


verify, as completely as all statements before they are 
accepted as facts, 


hypothesis or hypotheses 
-gathering instruments are 
a-gathering are appropriate 
d be available and adequate 


limitations and Sources of error in the. 
of data that would jeopardize the suc- 


À common fault is the ac- 


possible, 


Situation described its Size, it: 
tive composition, 
to the formulation 
data collected. 


Failure to 
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Placing a tally in the wrong cell or totaling the wrong set of scores 
can easily vitiate carefully gathered data. Errors sometimes may 
be attributed to clerical helpers with limited ability and interest 
in the research project. : 

4. Inappropriate statistical procedures. The application of the 
wrong statistical treatment may lead to conclusions that are invalid. 
This error may result from a lack of understanding of statistics or 
the limitations inherent in a particular statistical application. 

5. Computational errors. Since the statistical manipulation of 
data often involves large numbers and many separate operations, 
there are many opportunities for error. Readers are familiar with 
the story of the engineer who, after witnessing the collapse of his 
bridge, remarked, “I must have misplaced a decimal point.” There 
is no way to eliminate completely the fallible human element, but 
the use of either mechanical or electronic tabulating devices will 
help to reduce error. 

6. Faulty logic. This rather inclusive category may embrace a 
number of the sources of error in the thought processes of the 
The use of invalid assumptions, inappropriate analo- 
of cause and effect, confusion of a simple relation- 
failure to recognize that group phenomena 
to predict individual occurrences 
t the whole may be greater than 
of appearance is always 


researcher, 
gies, inversion 
ship with causation, 
may not be used indiscriminately 
or behavior, failure to realize tha 
the sum of its parts, belief that frequency 
a measure of importance, and many other errors, are limitations to 
accurate interpretation. 

7. The researchers unconscious bias. While objectivity is the 
ideal of research, few individuals achieve it completely. There is 
great temptation to omit evidence unfavorable to the hypothesis, 
and to overemphasize favorable data. The effective researcher is 
aware of his feelings and the likely areas of his bias, and constantly 
endeavors to maintain the objectivity that is essential. 

8. Lack of imagination. The quality of creative imagination dis- 
tinguishes the true researcher from the compiler. Knowledge of 
the field of inquiry, skill in research procedures, experience, and skill 
in logical thinking are qualities that enable the adroit researcher to 
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see possible relationships leading to generalizations that would 
escape the less skillful analyst. It is this ability to see all that there 
is in the data that produces significant discoveries, 


SUMMARY 


The analysis and interpretation of data represent the application 
of deductive and induc 


final result is new princi 
Data are examined in terms of com 


homogeneous segments of the w 
some outside criteria. 


The processes of classificatio 


parisons between the more 
hole group, and by comparison with 


n, sorting, and tabulation of data are 
arch process. In extensive studies 
and tabulating are used to save time 
and effort, and to minimize er-or, In less pretentious projects hand- 
Sorting and hand-tabulating Processes are usually employed, sug- 
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no sense complete nor. exhaustive. Only the most simple and basic 
concepts and processes are presented. Students whose mathemati- 
cal experiences include high school algebra should be able to under- 
of the materials presented and 


ples without diffculty. 
- The purpose of this chapter is twofold: 
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1. To help the student, as a consumer, to develop an understand- 
ing of statistical vocabulary and the concepts necessary to read 
with understanding the professional literature in educational re- 
search. 

2. To develop enough competence or "know-How" to carry on 
simple research studies, using simple types of statistical analysis. 

The emphasis is upon understanding and practical application 
rather than on the mathematical theory involved in the derivation 
of statistical formulas. Those who expect and need to develop 
real competence in educational research will need to take further 
steps by: ti 

1. Taking one or more courses in educational statistics. 

2. Studying more specialized textbooks in statistics, particularly 
those dealing with statistical inference as applied to the behavioral 
sciences, 

3. Reading research studies in professional journals critically and 
extensively. 

4. Carrying on research studies involving some serious "digging 
for one's self" in the use of statistical procedures. 


^ 


The role of measurement 


When knowledge is general and unanalyzed, it is usually de- 
scribed in vague, subjective terms. Such general judgments as good 
or bad are not supported by carefully gathered and analyzed data. 
But as knowledge in an area of human endeavor develops through 
research, specific, quantitative measures become increasingly impor- 
tant. The evaluation of phenomena is expressed in concrete terms 
of how much gain or loss, how much better or worse, or how closely 
related or different. j 

This quantitative emphasis is not in conflict with qualitative 
evaluation. It supplements and refines it, substituting objective evi- 
dence for hunch, hearsay, or feeling. Thus, research provides quan- 
titative measures as a foundation for the qualitative judgments that 
must be made in problem-solving. 


ə 
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WHAT IS "STATISTICS"? 


Statistics is the mathematical technique or process of gathering, 
describing, organizing, analyzing, and interpreting numerical data. 


Since research yields these quantitative data, statistics is a basic tool 
of measurement and research. 


The word statistics is SO; 
data that are collected. S 


and, as group characteristics, ma 


Worker who uses sta 
than the manipulation of data, 
fundamental pu 


Statistical meth 


tistics is concerned with more 
Statistical method goes back to 


2. What facts need to be gathered in order to provide the informa- 
ons? 


to be gathered, organized 
upon the problem? 


ns underlie the statistica] methodology that 


5. What conclusio 
the data? 


Broadly conceived, the field of Statistics involves 


ns can be logically drawn from the analysis of 


all of these 
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steps, and no research yields valid conclusions unless each step 
has been carefully and completely handled. 

Research in education may deal with two types of statistical data: 
descriptive and inferential. 


Descriptive statistics 


Descriptive statistics concerns numerical description of a particu- 
lar group. No conclusions are extended beyond the group de- 
scribed, and any similarity to those outside the group could not be 
taken for granted. The data describe this group, and this one group 
only. 

Much simple educational research involves descriptive statistics, 
and provides valuable information about the nature of a particular 
group or class. This is the type of data that is used as a basis 
for action research, described on p. 9. 


- Inferential statistics 


Inferential statistics involves the process of sampling, the selec- 
tion for study of a small group that is assumed to be representative 
of the large group from which it is drawn. The small group is 
known as the sample; the large group, the population or universe. 

Before this assumption of representativeness can be made, it is 
essential that the individuals selected be chosen in such a way that 
the small group, or sample, approximates the larger group or popu- 
lation. Within a margin of error, which is always present, and by 
the use of appropriate techniques, this approximation can be as- 
sumed, making possible the estimate of population characteristics 
by an analysis of the accessible sample. 

To study some populations directly would be impossible. Some 
populations are so large that their characteristics could never be 
measured completely; the task would have no end. Other studies, 
while possible, would involve too much time, money, and personnel 
to be practicable. Health authorities would find it wasteful, un- 
necessary, and virtually impossible to measure the blood pressure of 
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all American college women directly. The measured blood pres» 
sure of a few carefully chosen samples would yield reasonably 
accurate data for the entire population, 

The task of selecting a good representative sample is not easy. 
Of the many methods employed, two types will be described. 


The simple random sample 


In selecting a simple random sam 
tions are chosen in such a way tha 
in the entire population has an equ 


ple, the individuals or observa- 


from official autom 
Landon’s election proved to b 


€ wrong, and a postelection analysis 
revealed that the sample was Large num- 


utomobiles and were n 


; while a smaller one, care- 


y unbiased and accurate enough to 
make satisfactory inference possible, 


choosing a random sample is by the use of 
a table of random numbers. Such tables 


v 
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sired number of individuals is obtained. It is essential that the 
table order be followed meticulously to avoid bias in the process. 

There has been devised an unusual method of selecting random 
digits, using a ten-sided right cylinder. On each of the ten faces is 
a digit, numbered from 0 to 9. The cylinder is tossed into the 
air with a rapid spinning motion. The operator grasps the cylinder 
as it falls, his thumb pressing against one of the faces, After the 
digit thus obtained is recorded, the cylinder is tossed again. In 
this way a series of randomly selected digits may be produced. 

It is apparent that in order to select a random sample by any 
method, conscious selection of particular individuals must not enter 
the process. 


THE STRATIFIED SAMPLE 


At times it is advisable to subdivide the population into smaller, 
homogeneous groups, in order to get more accurate representation. 
For example, in making an income study of wage-earners in a com- 
munity, a true sample would approximate the same relative num- 
ber from each socio-economic level that characterized the whole 
community. If the proportion were 15 per cent professional work- 
ers, 10 per cent managers, 20 per cent skilled workers, and 55 per 
cent unskilled workers, the sample should include approximately 
the same proportions in order to be considered representative, 
Within each subgroup some process of probability selection is gen- 
erally used. This process gives the researcher a more representa- 
tive sample than one selected at random from the entire community, 
Which might be unduly weighted by a preponderance of unskilled 
Workers. à 

In addition to, or instead of, socio-economic status, such char- 
acteristics as age, sex, extent of formal eduĉation, racial origin, 
religious or political affiliation, or rural-urban residence might pro- 
vide a basis for the choice of a stratified sample. It is evident that 
the characteristics of the entire population together with the pur- 
poses of the study must be carefully considered before a stratified 
sample is decided upon. 
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It should be emphasized that when data are derived from a group 
without careful sampling procedures, the researcher should care- 
fully state that his findings are applicable to the group studied, and 
may not apply to or describe other individuals or groups. The 
statistical theory of sampling is complex and involves the estimate 
of error of inferred measurements, error that is inherent in estimat- 


ing the relationship between a sample and the population from 
which it is drawn. 


” THE ORGANIZATION OF DATA 


When numerical data are collected, they are difficult to analyze 
without some system of organization. This process of arranging 
data into tables is called tabulation. One method is to arrange the 
scores in descending order of magnitude—an array. Illustrated in 
Table 9-1 is an ungrouped data arrangement in array form, 


TABLE 9-1 
SCORES ON SEMESTER ALGEBRA TEST 
98 85 SOR 76 67 
97 85 80 76 67 
95 85 80 75 64 
93 84 80 73 60 
90 82 78 72 57 
88 82 78 70 
87 82 78 70 
87 80 77 70 


The data presented in Table 9-1 can be more easily examined if 
Some type of grouping is employed. This grouping results in a 
frequency distribution, If the frequency of distribution is presented 
in intervals of One, we have the pattern of Table 9-2, Note how 


much more clearly the data are presented when the scores are 
grouped. : 


Similarly, data can b 
class intervals, The 
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TABLE 9-2 
SCORES ON SEMESTER ALGEBRA TEST ° 
Score Tallies Frequency (f) 
98 / Asc 
97 / 1 
96 
95 / 1 
94 
93 
92 f 7 
91 
90 / 1 
89 Q 
88 / 1 
87 // 2 
86 
85 Lh 3 
84 / il 
83 
82 M1 3 
81 
80 5 
79 Cx 
78 > A ° 3 
77 / 1 
76 Hu 2 
75 h^ 1 
74 
73 / 1 
72 / 1 
71 
70 LL 8 
69 
68 
67 7 2 
66 
65 
64 1 
Es / 
62 
61 
60 / 1 
59 e 
58 
57 y 1 
Total N=37 


* Data grouped in intervals of one. 
N = total number of Scores 
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Walker and Lev? present a set of principles for selecting the class 
interval when a larger number of scores is encountered, suggesting 
that the number of intervals be set between ten and twenty, prefer- 
ably about fifteen. By dividing the range by 


fifteen, the approxi- 
mate width and number of the class intervals 


is established. 


Range/ Suggested No. of 
Score Score Range +15 Width I ntervals 
81 39 42 2.8 8 15 
125 60 65 43 5 13 
149 39 110 7.8 In 17 


A class interval with ano its i 
its midpoint is an integer 
Scores in an intery 


even interval of four: 8-11 8910 11 (midpoint is 9.5) 
odd interval of five: 8-12 g 9 10 11 12 (midpoint is 10) 
There is no rul 


e that rigidly determines th 
However, 


à common principle could be use 


l. Find the range (differ 
2. Divide range by 15, 
3. Set class interval at 


4. Establish the top sc 
interval, 


nearest odd interval, 


Ore so that it falls at the midpoint of the top 


Using the data presented in Tables 9-1 and 9-2; 
High Score 98 
Low Score 57 
Range 41 
41/15 = 2 11/15—.s 
Top Score 9g 
Top Interval 97-99 


elect an interval of three, 


Table 9-3 presents the Srouping as derived from the formula 
using an interval of three. Table 9.5 presents th 


e same data 
arranged by Srouping in intervals of five, 


1 Helen M, Walker and Joseph Ley, Elementa; 
(New York: Henry Holt & Com 


Ty Statistical Methods, rev. ed, 
pany, 1958). page 58. 
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TABLE 9-3 
SCORES ON SEMESTER ALGEBRA TEST ° 


Score. Tallies Frequency (f) 
97-99 ape — 
94-96 / 1 
91-93 / l 
88-90 / 2 
,85-87 5 
82-84 R 4 
79-81 IN 5 
76-78 la 6 
78-15 // 2 ^ 
70-72 Hg 4 
67-69 // 2 
64-66 / 1 
61-63 
58-60 / 1 
55-57 / 1 
Total N=87 


? Data grouped in intervals of three. 
N = total number of Scores 


2 ^ 
TABLE 9-4 
SCORES ON SEMESTER ALGEBRA TEST * 
Score Tallies Frequency (f) 
96-100 // 2 
91-95 y^ 2 
86-90 M1 4 
81-85 PHL 11 1 
76-80 THL PHL 11 
71-75 /l 3 
66-70 5 
61-65 / i 
56-60 // 2 
Total N=87 


? Data grouped in intervals of five. 
N = total number of Scores 


AIDS TO STATISTICAL CALCULATION 


After deciding upon appropriate ways of organizing and analyz- 
ing masses of data, the researcher. is confronted with problems 
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of counting, sorting, and the mathematical processes involved in the 
application of statistical formulas. Fortunately, the burden of these 
operations can be lightened considerably by the use of many aids 
to classification and calculation. Some devices serve in both classifi- 
cation and tabulation, while others are primarily helpful in facilitat- 
ing the mathematical processes involved in data analysis. 

When large numbers of items need to be tabulated and sorted, 


Remington Rand). By the use of ke 
on the cards. When they 


driven mechanical devices. From 


nched by a single operator in one 
1000 cards per minute. 


contribute a high degree of accuracy, 
Certain calculations can be co 
Saving the statistical worker th 
of tables are available that incl 
cals, and other computations u 
The newest contribution to 


pied directly from statistical tables, 
e job of calculation, Many books 
ude tables of Squares, roots, recipro- 
seful in statistical work. 
s the electronic com- 
The performance of 
S that problems that 
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remarkable-accuracy the results of the 1956 presidential election by 
mathematically projecting the impact of early returns. 

It is important to note that these devices not only save time and 
effort, but they also provide a degree of accuracy not possible with 
human effort alone. Of course, these devices. are operated by 
human operators, who are always susceptible to the errors due to 
carelessness, fatigue, or incompetency. 


STATISTICAL MEASURES 


In describing mass data and analyzing them in a meaningful way 
Several types of statistical measures are useful: 


1. Measures of central tendency 

2. Measures of relative position 

3. Measures of variability, spread, or dispersion 
4. Measures of relationship 


While there are other statistical measures, they are beyond the 
scope of an elementary treatment. Only the more basic are con- 
sidered in this chapter. — , 


MEASURES OF CENTRAL TENDENCY 


These measures deal with averageness of a series of characteristics 
or scores. Groups of data are often described in terms of some 
measurement found near the middle of the distribution that in some 
way typifies it. 

The three most commonly used—the mean, the median, and the 
mode—will be described. E 


The mean (Mj 


The mean of a distribution is commonly understood as the arith- 
metic average, It is computed by dividing the sum of all the scores 
by the number of scores. 
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M: = E M. = Mean of the Scores 
N = = Sigma (Sum of) 
X = Scores 
N = Number of Scores 
Example: 6 - 
5 
4 
3 
2 
To =X = 20 
5 | 20 N= 5 
4 M:= 4 
In using grouped data the formula is written: 
M, = XX 


N 


f= frequency 


s illustrated by the 
following: j 
Ungrouped Data Method Grouped Data Method 
Score (intervals of three) 
14 Score f Midpoint (fX 
12 13-15 1 14 14 
12 10-12 4 11 44 
10 7-9 2 8 16 
10 4- 8 6 5 30 
8 1-3 3 2 6 
tf — = = 
6 N= 16 110 £(f)X 
6 
6 
5 
4 
4 
3 M, = 2(£)X 
EPI 
2 
— M.= 110/16 = 6.87 
112 
N=16 
Ex 
M. N 


M.—112/16 = 7.00 
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It is apparent that there is only a small difference between the 
mean scores as computed by ungrouped or grouped data methods. 


The median (Md) 


The median is a point (not necessarily a score) in an array, above 
and below which one-half the scores fall. It is a measure of posi- 


tion, rather than a measure of magnitude. In the following example 
the median is found by inspection. 


3 scores fall above 


3 scores fall below 


Hao oo - 
| 
= 
[9 


To compute the median in a series of ungrouped scores: 

l. Arrange the scores in array form. 

2. If the number of scores is odd, the median is the middle score. 

3. If the number of scores is even, the median is a point midway 
between the two middle scores, ^ 

The median is not affected by extremes at either end of the array. 


In the following examples"the median is the same for each array, 
A and B. 


l 
& 
Il 
r3 


4—Md=4 
3 
2 
1 


In certain types of analysis the median may portray, more accu- 
rately than any other measure, the position of central tendency. 
In a small school with five faculty members the salaries are: 


HNOKMUO ID 
n 


Teacher A $7500 
B 4800 
[0] 4700 — Md Mean salary $5200 
D 4600 Median * 4700 
E 4400 
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The average salary of this group is better represented by the 
median salary ($4700) of teacher C, than by the mean salary 
($5200), which is more than the income of four of the five f. 
members. It should be emphasized that the medi 
central position only, and cannot enter into 
ship with other scores, 


aculty 
an is a measure of 
any algebraic relation- 


The mode (Mo) 


The mode is the score that occurs mos 
tion. It is located by inspection, and is 


since, like the median, it cannot later en 
tionships. 


If the ages of a group of fifth grade children were presented in 
tabular form, it is likely that the modal age would be ten years. 
There are more ten-year-old fifth-grade children than any other 
age. A men’s wear salesman will verify the fact that there are more 
sales of men’s size 40 Suits than any other size, Consequently, a 
larger number of size 40 suits are ordered and kept in stock, 40 
being the mode. 

In some distributions there may be more than one mode—several 
points at which a particular measure or score is prominent. A 
distribution with two such points is bimodal. In grouped data 


the mode is assumed to be the mid-score of the interval in which 
the greatest frequency occurs, 


t frequently in a distribu- 
a measure of position only 
ter into mathematical rela- 


MEASURES OF RELATIVE POSITION 


The percentile 


Often useful to describe a scor 


e in relation to the position of 
other scores in an array, 


the percentile is the point in an array 
below which a given percentage of scores falls. If the 80th per- 
centile in an array is score 68, it indicates that 80 per cent of the 
Scores fall below score 68. : 

Some state universities, in Cooperation with departments of public 


instruction, administer a psychological test to all high school seniors. 
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After the tests are scored, each school receives a report on the per- 
formance of each student expressed in percentile score, comparing 
the student with all other high school seniors in the state. A stu- 
dent whose score was at the 98th percentile excelled 98 per cent of 
all students who took the test, and he stood in the top 2 per cent of 
the whole group. These scores prove to be useful in predicting 
academic success in college work, and enable the high schools to 
evaluate their students in terms of all other students in the state. 

High schools frequently rate their graduating seniors in terms 
of their rank in class. Because schools vary so much in enrollment, 
colleges find these rankings of limited value. Translating these 
rankings into percentile rank is a useful method of giving a more 
meaningful interpretation to the rank. 

Jones ranks 27th in his senior class of 139 students. Twenty-six 
rank above him, 112 below him. His percentile rank, the midpoint 
of his position in the group, is computed by the formula: 


PR = 1002 a 50) © R — rank from top 


PR = 100 — (2700—50) _ 


139 = 81 (rounded to nearest 


whole number) 


At times it is useful to find a score when the percentile rank is 
known. To find the score: 


1. Multiply the total number of scores by the percentile rank 
given. 

2, Count this number of scores from the lowest score in the array. 

8. The point reached is the percentile score sought. 


If the data are arranged in intervals of müre than one unit, it is 
necessary to interpolate or find the position within the class interval 
Occupied by the desired score. 


2 For a description of this computation, see Henry E. Garrett, Elementary 
Statistics (New York: Longmans Green and Co., 1958), pp. 66-68; and Helen 
M. Walker and Joseph Lev, Elementary Statistical Methods (New York: Henry 
Holt & Co., 1958), pp. 70-13. ] 


216 THE STATISTICAL ANALYSIS OF DATA 


Certain percentiles are important enough to have special names, 
The 25th percentile is known as the Ist quartile (Q;). Twenty- 
five per cent of the scores fall below it. The 50th percentile is the 
median or second quartile, and the 75th percentile is the third 
quartile (Q5). The 10th, 20th, 30th, 40th, etc., percentiles are 
known as the first, second, third, fourth, etc., deciles. 


Measures of deviation, spread or dispersion 


Measures of central tendency describe certain characteristics of 


mass data. There are other characteristics that call for additional 
types of statistical analysis, where the mean, median, or mode should 
be supplemented by additional measures, 


The following scores were made by two groups of students: 


Group I Group II 
Pupil Score Pupil Score 

A 100 J 62 
B 80 K 61 
c 60 L 60 
D 40 M 59 
E 20 N 58 
=X = 300 =X = 800 

N= 5 Nie) 

M.— 60 M:= 60 

Md= 60 Md= 60 


=X sum of the scores 
N number of scores 

Mx mean score 

Md median score 


It is apparent that measures of central tendency do not describe 


the differences in achievement between Students in Group I and 
those in Group IL It is necess, 


Scores, 
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Range 


The most simple measure of dispersion is the range, the difference 
between the highest score and the lowest score ip an array. 


Range — highest score — lowest score 


The interquartile range is the difference between the third 
quartile point and the first quartile point. 


Interquartile range = Qs — Q, or Prs — Pos e 


The semi-interquartile range is half the interquartile range. 
Semi-interquartile range = Q: =Q: 


Some statisticians use as a measure of dispersion the interper- 
centile range, which is the difference between any two symmetri- 
cally placed percentiles. Such measures as Poo — Pio or Pog — Pr 
are frequently used, and have the merit of excluding the extremes 
or any few erratic scores at the ends of the distribution. Note that 
the limits of the interpercentile range fall at an equal distance from 


the Md or Ps: 
Pos ura P: 
(Pso + 43) (Pso — 43) 
Thus the percentile, the decile, and the quartile serve not only as 
measures of position, but also provide a basis for establishing certain 


measures of dispersion or spread. 


DEVIATION FROM THE MEAN {SMALL x) 


The deviation of a score is its distance from the mean of the dis- 
tribution, and is defined in symbols as: 


x = (X — Mx) 
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Standard deviation{s} 


those below the mean have a negative value, 
deviation, rather than the direction of deviatio 
measure of average dispersion, the deviations 
nate the signs, Thus, the measure of stand 


$ SEM eun. 
standard deviation(s) — v ZIEM or yy Woy 


(N—1) 


Z = sum of Scores 
= raw score 
M: = mean of scores 
= number 


TE the scores are arranged in Srouped data form, the formula is: 


X(f)e 
Vies 
f= frequency of appearance 
When the deviation method is used, th 


from the midpoint of each class interval, 


In actua] Practice the deviation method 
puting the standard deviation, 


€ deviations are measured 


is rarely used in com- 
A calculator, or a table of Squares 


strates the Computation of 
Standard deviation, using the raw score formula 
Scores in array form 90 70 65 
85 68 65 
83 68 61 
80 68 
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x f fX 2 2 
90 1 90 8100 8100 
85 1 85 7225 7225 
83 1 83 6889 6889 
80 1 80 6400 6400 
70 1 70 4900 , 4900 
68 3 204 4624 18872 
65 2 130 4925 8450 
61 1 61 3721 3721 

N=11 803 59557 
ses y ness — (803); _ , /655.127 — 644,809 

= (11) (10) Sy o . 


s — 4/20318 _ | /93.80 = 9.69 
DV Uh0e = 


The larger the value of the standard deviation(s), the greater 
the spread or dispersion; the smaller the value of the standard devia- 
tion, the smaller the dispersion. 


Sigma score (small z) „ * 


In describing a score in a distribution, its deviation from the mean, 
expressed in number of standard deviations, is often more significant 
than the score itself. The sigma score (z) is a useful device, for it 
reduces scores in any type of distribution to a common, comparable 
unit of measure. 


X — raw score 
x — deviation 
s — standard deviation 


In comparing or averaging scores on tests where total point values 
differ, the use of raw scores to compute a mean or average may 
Create a false basis for comparison. The z score makes possible 
equal weighting of the tests. On the z scale the mean of the z 
values is equal to zero, and the standard deviation equal to 1. 

A teacher wished to get a student's equally weighted average on 
an algebra test and an English test. 
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Highest Possible Standard 


Subject Raw Score Mean Score Deviation(s) 
7 5 
bi 40 47 60 
rm 84 110 180 20 


P 84—110 . 
English z score — a = 390 — —13 


Standard score [large Z) 


Own as a Z score, The Z score scale no 
a standard deviation o£ 10. 


Z=10z + 50 


Algebra Z — 10(—1.4) 4. 59 — —14 + 50 — 36 

English Z — 10(—1.3) gi290.— 915 + 50 = 37 

The standard Scores in algebra and English indj 
equal standard of performance On each test, 


Course Haw Score Z Score Z Score 

Algebra & 40 —14 36 

English 84 —13 37 
ean 62 —1.85 36.5 
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THE NORMAL DISTRIBUTION 


The earliest mathematical analysis of the theory of probability 
dates back to the eighteenth century. Abraham DeMoivre, a 
French imathematician, discovered that a mathematical principle 
explained the probabilities associated with various games of chance. 
He developed the equation and the curvilinear pattern that de- 
Scribes it. During the nineteenth century, a French astronomer, 
La Place, and a German mathematician, Gauss, independently 
arrived at the same principle and applied it more broadly to areas? 
of measurement in the physical sciences. From the limited applica- 
tions made by these early mathematician-astronomers, the theory 
of probability has been applied to data gathered in the areas of 
biology, psychology, sociology, and economics. It has also been 
found to describe the fluctuations or chance errors of observation 
and measurement. 

Some understanding of the theory of probability and the nature 
of the curve of normal distribution is necessary for an understanding 
of many important statistical concepts, particularly in the area of 
inferential statistics and the theory of sampling. 

The law of probability and the normal curve that describes it 
are based upon the law of chance or the probable occurrence of 
certain events. When any body of data conforms completely to 
this mathematical form, it can be represented by a bell-shaped 
curve with definite symmetrical characteristics. There is little 
question that the operation of chance prevails in the tossing of coins 
or dice. It-is believed that many human characteristics appear or 
occur by chance. For example, if certain limits of age, race, and 
Sex were kept constant, such measures as height and weight would 
approximate the normal pattern. But the normal distribution is not 
as universal in its application as many people believe. It is unlikely 
that any set of data derived from social or psychological data con- 
forms exactly to the normal curve. There is usually some deviation 
from the symmetrical pattern. But for the sake of statistical 
analysis, it is assumed that many characteristics do conform to this 
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mathematical form within certain limits, providing a convenient 
reference, 

The concept of measured intelligence is based upon the assump- 
tion that intelligence is distributed normally throughout certain 
limited segments of the population, Tests are so constructed that 


Scores are normally distributed in the group that is used for the 
determination of norms or standards, 


Insurance Companies determine their 


life insurance company, 
an estimate quite ac- 
Survive to age forty- 
ath of any one policy- 
group, they can Predict with reasonable 


on discovered by De- 
S imes, the Probabilities 
would be: 


(h+t)?=h?+ one jg 
EF il 


appear by chance, 


1 h? one chance in four of both coins falling heads 1/4 
2 ht two chances in four of one head and one tail 1/2 
1 t? one chance in four of both coins falling tails 1/4 


4 total tosses 


If four coins Were tossed sixteen times, the probabilities would be: 


(h4t)¢—ps + 4hst 4 Ghate 4. 4ht 4. tt 
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l hf one chance in 16 of all four coins falling heads 1/16 


4 hêt four chances in 16 of 3 heads and 1 tail 4/16 
6 h?t? six chances in 16 of 2 heads and 2 tails 6/16 
4 ht? four chances in 16 of 1 head and 3 tails 4/16 


lt* one chance in 16 of all four coins falling tails — 1/16. 


16 total tosses 


2 


In an interesting class preparation assignment twenty students 
each tossed four coins at a time, sixteen times. Each student tabu- 
lated the number of heads appearing on each toss, and compared the 
results with the number that could be expected by chance. The fre- 
quencies were totaled (see Table 9-5), and a frequency polygon to* 
illustrate the expected and observed frequencies was constructed 
(see Fig. 9-2). 

TABLE 9-5 
EXPECTED AND OBSERVED NUMBER OF HEADS APPEARING 


WHEN TWENTY STUDENTS TOSSED FOUR 
COINS SIXTEEN TIMES 


Number of heads > Theoretical or Observed 
appearing expected f f 

0 20 30 
1 x 80 65 
2 120 125 
3 80 85 
4 20 15 

N = 320 320 


f — frequency of appearance 
N = number of tosses 


Note the deviation between the observed frequencies and the 
expected frequencies. However, there is an indication of sym- 
Metry that would conform more closely to the pattern of the normal 
curve as the number of tosses was increased. When the expression 
(h 4- +t)" becomes infinite, the resulting sides of the frequency 
polygon grow shorter, finally approaching a curved line, the normal 
Curve. Since the tossing of coins illustrates the operation of chance, 
this experiment shows the operation of probability and the nature 
of the normal curve of distribution, 
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frequency 
of 


appearance 


1 2 3 4 
Number of heads appearing 


Fig. 9-1. Expected and observed number of heads appearing when 
twenty students tossed four coins sixteen times, 


The normal curve of probability can also be described in terms 
of standard deviation, a mathematical function of the curve. Table 
9-6 illustrates the nature of this relationship, 


TABLE 9-6 
AREA RELATIONSHIPS UNDER THE NORMAL CURVE 
Area under normal Area under normal 
Distance from the Curve: percentage Range in curve: percentage 
mean in standard of frequencies standard of frequencies 
deviations included deviations included 

—1 34.13 

+1 34.13 —i to +1 68.26 

—2 47.72 

+2 47.72 —2 to +2 .95.44 

—8 49.86 

T3 49.86 —8 to +3 99.73 

—4 49.985 

T4 49.985 —4to 4-4 99.97 


In a normal distribution 


the mean, median, and mode all meet 
at the same point. Note al: 


so that the curve never reaches the base 
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line, always permitting the possibility that the unexpected may 
happen, however unusual it may be. 


Fig. 9-2. Percentage of frequencies in a normal distribution falling 
within the range of a given number of standard deviations. 


Practical applications of the normal curve 


In the field of educationalresearch there are a number of prac- 
tical applications of the normal distribution, among which are: 

l. To evaluate the normality of a given frequency distribution. 
This may be accomplished by superimposing upon the given fre- 
quency polygon a theoretically normal distribution curve, with 
equivalent frequency, mean and standard deviation. 

2. To scale qualitative data by transforming them into numerical 
Scores, These data to be scaled may be answers to questionnaires 
and opinionnaires, or judgments, ratings, or rankings. 

3. To test reliability or significance of obtained values in samples. 
These values can be related to the possibilities that might have 
resulted from chance fluctuations in drawing the sample. Such a 
comparison would yield a level of confidence in assuming the ob- 
tained values to be statistically significant. 

4. To convert raw scores into standard scores. 

5. To normalize a frequency distribution. Ordinarily, this is an 
important part of the process of standardizing a psychological test. 
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Statistical inference 


Descriptive statistical measures (such as the mean or the stand- 
ard deviation) of a randomly selected sample are known as esti- 
mates. ‘The actual value of the Corresponding statistical measure of 
the parent population is known as a parameter. Ordinarily, the 
parameter cannot be measured directly, but must be inferred from 
the randomly selected sample estimates that can be measured. 


The central limit theorem 


Estimates derived from a nu 
will differ from one another. 
assume a distribution form tha 
distribution. This principle is 


mber of randomly selected samples 
When plotted, these estimates will 
t approximates the normal curve of 


known as the central limit theorem. 
For example, if the means computed from randomly selected sam- 


ples drawn from a population were plotted, their curve of distribu- 
tion would approximate the normal curve. The true mean (or 
parameter) of the population would be the mean of the sample 
means (estimates). About 68 per cent of these sample means 
would fall within the limits o£ -1 standard deviation from the true 
mean, about 95 per cent within the limits of +2 standard devia- 
tions, and about 99 per cent within the limits of +3 standard devia- 
tions, 

The centrallimit theorem has 
educational research. 
periment described on 
mental group was com 
group. Would a grea: 
cate the possible supe 
possible that the mex 
tions of the sample m 


many practical applications in 
In the classroom parallel-equated group ox- 
page 132 the pupil mean gain for the experi- 
pared with the pupil mean gain for the control 
ter pupil mean gain in one of the groups indi- 
riority of the experimental variable? Or is it 
ns of the two groups differ because of varia- 
eans drawn from the parent population? 


The null hypothesis 


The null hypothesis assumes that an observed estimate reflects the 
fluctuations of the random sampling process or chance variation. It 
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questions or doubts the effect of an experimental variable until the 
effect is demonstrated to be a significant difference, rather than the 
result of chance. 

In the example of the classroom experiment the null hypothesis 
asserts that the difference between the pupil mean gains for the 
two groups resulted from chance. To prove that the difference was 
statistically significant, the null hypothesis would have to be re- 
jected. Only if the null hypothesis were successfully rejected 
could the possible superiority of one of the teaching methods, or 
experimental variables, be inferred. The word possible is impor- 
tant here because rejection of the null hypothesis would not neces- 
sarily prove the superiority of an experimental variable. It would 
only discount the likelihood that sampling variations would explain 
the obtained difference. 


Tests of significance 


A critical ratio, or t test, of the significance of the difference be- 
tween two means yields a numerical Value. When located on an 
appropriate statistical table (table of t), this measure indicates a 
level of confidence for rejection of the null hypothesis. If the 
significance of the difference exceeded the 5 per cent level of con- 
fidence, it could be concluded that chance fluctuations in the esti- 
mates could account for such a difference in as many as five out of 
one hundred cases. If the difference were great enough to exceed 
the I per cent level of confidence, such a difference could be attrib- 
uted to chance in only one in a hundred cases. Thus, the null 
hypothesis would be rejected with a high degree of confidence. 


The chi square (X^) 


o 

When data are classified into categories representing distinctive 
characteristics, the operation of the laws of probability might ac- 
count for some of the cases that fall into each category. It is im- 
Portant to know whether these proportions merely reflect the 
Operation of chance, or whether their appearance probably results 
from a significant controlling factor. 
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For example, in a test where ninety men are given a blindfold 
test to choose the mildest of three brands of cigarettes, how should 
the results be interpreted? Jf there really is no distinguishable 
difference between the brands, about thirty would be expected to 
» about thirty, Brand B, and about thirty, Brand C. 


expected frequency is squared 


» and divided by the expected or 
theoretical frequency, and the 


sum of these quotients is chi square 
(X*). In order to determine the significance of the chi square 
obtained, it is necessary to refer to the chi Square table. Values 
are given in levels of confidence. Thus, if a given chi square is 
significant at the 5 per cent level of confid. 


STANINE OR STA (NDARD) NINE-POINT SCALE 


In their program of psychological testing and classification statis- 
ticians of the United States Air Force have devised a single-digit, 
nine-point scale of standard scores. This system is based on the 
assumption that a large number of Psychological scores will be nor- 


3 For an explanation of this computation, see Henry E. Garrett, ibid., pp. 
122-132, 
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Inally distributed, or will conform to the normal probability curve. 
The term sranine is derived from the words standard and nine. 
The total distribution is divided into nine categories, each category, 
cxcept 9 and 1, one-half standard deviation in width,* with a mean 
of five and a standard deviation of two. Table.9-7 indicates the 
percentage of cases that fall in each stanine. 


TABLE 9-7 
THE STANINE OR STANDARD SCORE 


— N a a 


Area under the ə 

Standard deviation normal curve Rounded 

Stanine range in per cent per cent 
9 above +1.75 4.01 4 
8 +1.25 to +1.75 6.55 7 
7 +.75 to +1.25 12.10 12 
6 +.25to +.75 17.47 17 
5 —.25to +.25 19.74 20 
4 —.75to —.25 17.47 17 
3 —1.25 to —.75 12.10 12 
2 —1.75 to —1.25 6.55 7 
1 below —1.75 x 4.01 4 
100.00 100 


In assigning standard scores, raw scores are arranged in array 
form, and then assigned stanine scores by percentage distribution. 
The top 4 per cent would be assigned stanine 9, the next highest 
7 per cent, stanine 8, the next 12 per cent, stanine 7, etc. In this 
way standard scores or stanines can be assigned without computing 
standard deviations. After the original raw test scores are assigned 
stanine categories, a table of equivalencies can be constructed to 
convert subsequent raw test scores to stanines, 


Normalizing distributions 9 


In standardizing psychological tests the assumption is usually 
made that the behavior to be measured is normally distributed in 
*Stanines 9 and 1 are open-ended and have a width greater than one-half 


Standard deviation. However, few cases are included at the upper and lower 
tail extremes, and the distribution of scores is not significantly altered, 
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the population. For administration to groups for the purpose of 
establishing norms, the test items are chosen in such a way that 
the obtained score frequencies approximate the normal distribu- 
tion. This is an important process in standardizing a test, The 
concept is sometimes applied to grading student achievement ina 
particular academic course. The following procedure has been 


widely used: 
Deviation from the 
mean in standard Percentage 

Academic grade deviations of cases 
D: A above +1,5 7 

B from +.5to 415 24 

G from —.5 to +.5 88 

D ` from —L5to —5 24 

F below —1.5 yé 


4. an unselected distribution, 
asures of academic achieve- 


MEASURES OF RELATIONSHIP 


Correlation 


tionship between two or more paired 
variables, that is, two or more sets of data, The degree of relation- 
ship may be measured and represented by the coefficient of correla- 


tion. This coefficient is identified either by the Greek letter rho (p) 
or the symbol r. 
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Ship obtains, the factors of measured intelligence and scores on 
arithmetic tests are said to be positively correlated. 

Sometimes pairs of traits are negatively correlated. When a 
large amount of one variable is associated with a small amount of 
another, as one increases, the other decreases. When the rela- 
tionship between two variables is a pure chance relationship, we 
say that there is no correlation. The following pairs of traits are 
usually positively correlated: 


Intelligence School marks 

Cost of farm land Productivity per acre z 
Age Cost of life insurance 

Age of husbands Age of wives 

Size of family income Cost of family car 


These traits are usually negatively correlated. As one increases, 
the other tends to decrease. 


Age of an automobile Trade-in value 

Time spent in practice Number of typing errors 
Amount of unemployment Department store sales 
Total corn production Price per bushel 


There are other traits that probably have no significant measurable 
relationship. 


Body weight Intelligence 
Shoe size P Monthly salary 
The degree of relationship can be represented numerically by the 

coefficient of correlation. A perfect positive coefficient of correla- 
tion is +1.00. A perfect negative coefficient of correlation is — 1.00. 
A pure chance relationship is zero (0). Rarely are perfect co- 
efficients of correlation of +1.00 or —1.00 encountered, particu- 
larly in relating human traits, While some relationships tend to 
appear fairly consistently, there are usually exceptions that reduce 
the measured coefficient from either a —1.00 or a +1.00 toward 
zero, 


The scattergram and regression line 


When the relationship between two variables is represented 
&raphically, test scores made by a subject are plotted against each 
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other on the X and Y axes. Fig. 9-3 represents scores made by five 
students. The line drawn through or near to the five points is known 


x Y. 

A 100 90 
a3 80 Do M 
C 75 18 o 
D 60 55 & 
E 40 45 g 
» 


10°20 30 40 50 60 70 80 90 100 


X values 


x Y 
n 
A 100 20 S 
B 90 25 d 
c 80 2 $ 
D 70 28 y 
E 60 30 


10 20 30 40 50 60 70 80 90 100 


X values 


Fig. 9-4. 


The scattergram in Fig. 9-4 


illustrates a negative coefficient of 
correlation. The value of the 


coefficient of correlation determines 
Note the difference in slant be- 
tween a positive and à negative coefficient. 

zero, the points determined by 
farther from the regression line. 
n is +1.00 or —1.00, the regres- 
sion line passes through each point. Fig, 9-5 illustrates a coefficient 
of correlation of +1.00. A coefficient of correlation of — 1.00 would 
make a similar slant in the opposite direction, 
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x Y 100 

A- 100, a 200 90 
B 90 90 80 
@ 80 80 70 
D 70 10 8 60 
E 60 60 a3 50 
"u 10 

> 30 

» 20 

10 

o 


10 20 30 40 50 60 70 80 90 100 


X values 


Fig. 9-5. 


Prediction of one variable from another 


After the coefficient of correlation has been computed between 
two sets of data, certain predictions are possible. Ifa given X score 
is known, the corresponding or expected Y score can be predicted. 
Or if the Y score is known, the X score can be predicted. 


Predicting X from Y. X' = rom (Y—M,) +M 
^ y 


Predicting Y from X. Y= LE (X— Mi) + M, 


Sx = standard deviation of X scores M, = mean of X scores 
Sy = standard deviation of Y scores M, — mean of Y scores 


The higher the coefficient of correlation, the more accurately 
à curresponding score can be predicted. The plus or minus sign 
merely indicates the direction of the relationship. Thus a coefficient 
of —.90 is as useful for predictive purposes as a coefficient of --.90. 
Since all points will fall on the regression line when the coefficient 
is either —1.00 or +1.00, perfect prediction is possible. 
A measure of correlation is said to be lineĝr if the relationship 
is fairly consistent along the whole range of paired scores. 


Computing rank order correlation (p. rho) 


The simplest type of analysis is known as the Spearman Rank 
Order method. This analysis is appropriate when a relatively small 
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number (fewer than thirty pairs) of scores are being related. The 
variables are expressed in rank order, rather than as raw scores. 


This type of analysis lends itself to an interesting graphic demon- 
station. » : 


Pupil 1.Q. Rank Arithmetic Rank 
A D M 00m Tm 
B a 2 
c S TT 8 ; 
D omm LIMEN RN 4  p(rho) coefficient 
E 5 CTRICO—————— of correlation. 
p = +1.00 
A perfect positive correlation. Student first in LQ rank is first in arithmetic, 
etc. 


Time Spent in Typing 


Number of Errors 
Pupil Practice—Rank Rank 
A 1 5 

B : 


2 

2 4 
Cc 3. 3 
D 4 2 


A perfect negative correlation. Sty 


ident who ranks first i 
Practice is lowest in number of er 


n time spent on typing 


Tors, etc. 
Height LQ. 
Pupil Rank Rank 
A 1 3 
B 2 4 
Cc 3 2 
D 4 1 
E 5 5 


UCM INN à 
p=+.10 


This correlation is very low. Th 


e coefficient is low e 
there is no significant relationship, 


nough to conclude that 


an Rank 


o= Ox 
== the sum of 
D — difference between ranks 
— number of paired ranks 
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RANKING OF FIVE PUPILS IN A SPEECH CONTEST BY 
JUDGES JONES AND SMITH 


Pupil Jones Rank Smith Rank D p? 
A 1 2 1, 1 
B 2 1 1 1 
Cc 3 5 2 4 
D 4 3 1 1 
E 5 4 1 I 
N=5 8(=D*) 
ak 6(8) . 48 — E : 
DE —15—5-—1-—359—1- 40= +60 J 


Ranking tie scores 


. Whenever two or more individuals receive the same score in an 
array, each individual is assigned the mean rank position of the 
tie scores. Note how ranking of ties is accomplished when there 
are two tie scores in example A, and three ties in example B: 


A > B 
score rank score rank 
25 T 25 T 
21 2 21 2 
19 3.5 19 4 
19 3.5 19 4 
T 5 19 4 
14 6 14 6 
12 7 12 7 


The rank order method of computing the coefficient of correla- 
tion is considered appropriate when there are few ties and the num- 
ber of cases is relatively small. Teachers doing simple correlational 
studies in a single classroom will find this procedure uncomplicated. 


Compuling the coefficient of correlation by the raw score method (r) 


When larger numbers of paired scores are involved, a raw 
Score method is more appropriate and more accurate. There are 
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many formulas that may be used 
relation, all derived from the 
formula. 
Two formulas will be presented: 
Method I: Using totals of raw Scores. 
tronic computer is used.) 


to compute the coefficient of cor- 
definitional Pearson Product-Moment 


(Practicable when an elec- 
N.XXY — (ZX.xy) 
1 i LS E m 
Nm (3X)*] [NZY: — (xy)s] 


=X = Sum of the X scores 

=Y = Sum of the Y scores 

=X? = Sum of the X scores squared 
ZY? = Sum of the Y scores s uared 
IXY = Sum of the product of X, Y scores 


| 
X Y xe Y2 XY 

10 30 100 900 300 

20 20 400 400 400 

30 60 900 3600 1800 

40 50 1600 2500 2000 

50 40 2500 1600 2000 


EX2? 5500 XY? 9000 ZXY 6500 


N=5 
substituting in the formula: 


32,500 30,000 
5( 6500) — (150) (200) 


435500) — (150)*] [5(9000) — (200)2] 
27,500 — 22,500 45,000 — 40,000 
5000 5000 
2500 


= o0ME 50 E 
: | (8000) (5000) 5000 = + 


T= 4.50 
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Method II: Another interesting variant, using the means of raw 
Scores (same data): 


Mxy — Mx.My 


[Mx: — (Mx)?] [My — (My)2] 


xm 


This formula involves the means of the columns used in the previ- 
ous example. 


X x x? y2 XY 
10 30 100 900 300 
20 20 400 400 400 
30 60 900 3600 1800 
40 50 1600 2500 2000 
50 40 2500 1600 2000 
5 [150 5 200 5 | 5500 5 | 9000 5 [6500 
Mx 80 Mr 40 Mx; 1100 My. 1800 Mxx 1300 
: N=5 
substituting in the formula: 
1300 E 100 
= mix m -—— — W gp 
a{ {1100 — (30)2] [1800 — (40)2] , /(200) (200) 
900 1600 
(200) (200) 


r= 4.50 


Up to thi: point in the discussion we have considered only linear 
or straight line relationships which represent a constant relationship 
between the variables. b 


Curvilinear correlation 


There are situations in which the relationship between two sets 
of data does not follow the straight line pattern. The effect of rain- 
fall on wheat production provides an interesting example. To a 
Certain point, increased rainfall will bring increased crop yield, a 
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positive correlation. But beyond this point, too much rain will 
operate negatively, bringing plant rot and a decline in crop yield. 


Crop yield 
in 5 

Ei acre -€— L To this point 
50 increased rainfall 
45 brings increased crop 
40 Yield; beyond it, in- 
35 creased rainfall brings 
30 


a decline in yield, 


d. py Sy ih 586. 7T. BI Tg. 10 11 12 13 14 15 16 17 18 19 
Amount of rainfall in inches 


Fig. 9-6. Curvilinear Correlation, 


A similar curvilinear correlation exists between the variables of 
human age and strength. To a certain point, strength increases 


with age (a positive correlation), but beyond that point strength 
begins to decline (a negative correlation), 


vanced students who wish to find the subject treated in greater 
detail, a number of useful references are found at the end of this 


Partial and multiple correlation 


It is possible to, measure the relationships between more than 
two variables through the process of partial correlation. This is 
done by holding Certain of the variables constant, or momentarily 
eliminating them from consideration, thus “partialling out” the in- 
fluence of an independent factor, Partial correlation makes pos- 
sible multiple correlation, useful in establishing the relative influ- 


ence or the weight of each of the factors in the relationship. For 


example, a midwestern State university has computed a multiple 


regression equation involving three weighted factors closely related 
to academic success in college: 
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l. Rank in high school class 

2. Measured intelligence 

3. Scores on entrance examination 

These three, combined in proper proportion, proved to be more 
accurate for prediction of college success than any one or two of 
the factors. - 


Interpretation of the coefficient of correlation 


There are several fallacies and limitations that should be con- 
sidered in interpreting the meaning of a coefficient of correlatioa. 
A coefficient does not imply a cause-effect relationship between 
the variables. High positive coefficients of correlation have been 
observed between the number of ordinations of ministers in the 
New England Colonies and the consumption of gallons of whiskey, 
and between the importation of bananas and the tonnage of the 
British Navy. Although these coefficients of correlation are statisti- 
cally genuine, and may be explained by such a common factor as 
the growth of population, it would be spurious analysis to interpret 
one as the cause of the other. Nor could any useful conclusions 
be drawn by correlating the’decline in sale of buggy whips and the 
increase of juvenile delinquency. Technological and social change 
may be underlying factors in this relationship. Before a causal 
relationship between variables can be accepted, it must be estab- 
lished by logical analysis. The process of computing the coefficient 
of correlation only quantifies the relationship that has been previ- 
ously established. A relationship of a particular type may exist 
only within certain limits, and must be tested to determine whether 
it is linear or curvilinear. Logical analysis must also be applied to 
determine what other factors may be a significarit part of the pat- 


tern. 
LI 


Magnitude of the coefficient 


Frequently textbook authors present a general criterion for the 
evaluation of the significance of coefficients. 
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Coefficient (r) Relationship 
00to +.20 negligible 
+.20to +.40 low or slight 
+.40to +.60 moderate 
+.60to +.80 substantial or marked 
=+.80 to £1.00 high to very high 


The foregoing is a crude analysis and may be somewhat mislead- 
ing. The significance of a coefficient of correlation depends upon 
the nature of the factors related, the number of cases involved, the 
range of score data, and the purposes of the application of the 


Prediction of Sroup performance 


A coefficient of correlation represents an averaging of the indi- 
vidual relationships between paired variables. This fact is illus- 
trated by Figs. 9-3 and 9-4, which show lines of regression. When 
alized measure, the coefficient is useful in 
This principle is widely applied in 
admission, or for screening candi- 


general, but much less valid i 
particular student, 


o 
Prediction of individual performance 
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likely to be accurate enough to be useful. The Index of Forecasting 
Efficiency has been devised, and can be used to compute the prob- 
able accuracy of prediction for any value of r, by the use of the 
formula: 


E—100(1— /1— r2) 
This index indicates the percentage improvement in predictive 
ability of a coefficient of correlation over a pure chance guess. 


r E(%) 
10 5 
.20 2.0 3 
.30 4.6 
.40 8.3 
50 13.4 
.60 20.0 
-70 28.6 
.80 40.0 
.867 50.0 Note that in predictive ability, an r of 
.90 56.4 .867 provides only a 50 per cent im- 
.95 68.8 provement over a pure chance guess. 
98 80.1 
99 85.9 
1.00 100.0 


It is apparent that the coefficients of correlation that are usually 
obtained would prove of limited value in predicting individual per- 
formance, although they might be quite useful in predicting the per- 
formance of groups of individuals. 


The significance of r 


The extent to which a given coefficient of correlation reflects a 
true relationship rather than one resulting from chance fluctuations 
in drawing the sample may be tested by applying the null hypothe- 
sis, (The null hypothesis would assert that the coefficient of the 
population was zero.) By referring to a table of values of r, based 
upon the number of pairs of variables used in the computation, 
levels of confidence may be established. This reading from the 
published table of values indicates how large a coefficient should 
be in order to reject the null hypothesis, at given levels of con- 
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fidence. A value of r exceeding the 5 per cent level of confidence 
would indicate that such a coefficient could result from sampling 
fluctuations in not more than five in a hundred cases. A value 
exceeding the 1 per cent level would indicate that such a coefficient 


could result from sampling fluctuations in not more than one in a 
hundred cases, 


, the higher the coefficient, the greater is the accuracy of 


prediction. But there are occasions when a very low coefficient 


relation between the scores "o; 
and the scores on the readi 


authors had probably been successful, ät least 


A few of the basic procedures are 


To establish the validity of tests 


A test is said to be valid 
measure, or if it proves to 
Purpose. Standardized test: 
test scores with some out: 


if it measures what it is supposed to 
be useful in accomplishing its desired 
s are usually validated by correlating 
side criteria. These criteria may be 
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the coefficient of correlation between the test and valid outside 
criteria is high, the test is said to have a high coefficient of 
validity. 


To establish the reliability of tests * 


A test is reliable if it measures accurately and consistently, 
yielding comparable results when administered a number of times. 
The degree of reliability may be established by correlating the 
results when the same individuals take duplicate or equivalent forms 
of the test. The degree of reliability may also be established by 
correlating the scores on two or more successive administrations of 
the same test, putting the scores on the first administration of the 
test against scores made by the same students on a repeat perform- 
ance. 

Another test of reliability consists of correlating the scores on the 
odd itéms of the test (numbers 1,3,5,7, etc.) against the even items 
(numbers 2,4,6,8, etc.). 


A note of caution 


Statistics is an important tool of the research worker, and an 
understanding of statistical methodology and terminology is impor- 
tant for the consumer of research. There are a number of limita- 
tions, however, that should be remembered in using statistical 
3rocesses, in interpreting statistical processes, and in drawing con- 
clusions from statistical evidence. 

1. Statistical process is the servant of logic and only has value 
if it verifies, clarifies, and measures relationships that have been 
established by clear, logical analysis. Statistics is a means, never 
an end, of research. ` 

2. A statistical process should not be employed in the analysis 
of data unless the basic assumptions and limitations underlying its 


use are clearly understood. 


5A more complete discussion of both validity and reliability is presented 
in Chap. 7. 
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3. The conclusions derived from statistical analysis will be no 
more accurate or valid than the original data. All of the refine- 
ment of elaborate statistical manipulation will not yield significant 


4. All treatment. of data must be checked and double-checked 


of errors in measurement, 


t the population are made from meas- 
urements of statistica] samples, 


in 1900 to only 54 percent in 1953. He placed the blame on pro- 


School administrators for the "watering- 
down" of the course of study, 


9 Arthur Bestor, “We Are Less Educated Than 50 Years Ago,” U.S. News 
and World Report, November 80, 1956, p. 71, 


o 
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In an editorial in the Phi Delta Kappan, editor Stanley Elam 
took sharp issue with Bestor and, using the same data, arrived at 
an entirely different conclusion: * 


1900 1953 
14-17 age group in U.S. population 6,152,231 7,538,000 
14-17 age group in high school 695,903 6,358,000 
Per cent of age group in high school 11 843 
Number taking science courses 584,559 8,433,320 
Per cent of age group (14-17) taking high 
school science 9 44 


In answer to Bestor's charge that the number of high school stu; 
dents taking science had declined from 84 per cent to 54 per cent, 
Elam pointed out that the number of students in the 14-17 year age 
Sroup taking science had increased from 9 per cent to 44 per cent. 

Both writers use statistics; neither falsifies the data, yet the con- 
clusions seem to be in conflict. This analysis illustrates the role 
of logic in persuasion, the importance of basic premises, and shows 
how statistical data can be used to support a particular point of 
view, n 
Distortion may be deliberate or unintentional. In research, omit- 
ting certain facts or choosing only those facts favorable to one's 
Position is as culpable as actual distortion. In fact, it represents a 
type of distortion that has no place in research. The reader must 
always try to evaluate the manipulation of data, particularly when 
the purpose of the ‘report seems to be persuasive. 

One final observation concerning the use of statistical processes 
in educational research seems appropriate. Research reports, par- 
ticularly in the behavioral sciences, sometimes include elaborate 
Statistical processes that serve no useful purpose, but are apparently 
included to lend an air of scholarship and dignity to a superficial, 
barren study. It is needless to say that no statistical technique 
Should be employed unless it adds clarity or méaning to the analysis 
of data. Never should it be used as window-dressing to impress 
the reader, 


T Stanley Elam, editorial, Phi Delta Kappan, 38:4, January, 1957, p. 121. 
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SUMMARY 


The presentation of this chapter deals with only the most elemen- 
tary statistical concepts. For a more complete treatment the reader : 
is urged to consult one of the references listed in the chapter bibliog- 
raphy. Y 

Statistics is the mathematical process of gathering, organizing, 
analyzing, and interpreting numerical data, and is one of the basic 
phases of the research process. Descriptive statistics involves the 
description of a particular group. Inferential statistics leads to 


judgments about the whole population, of which the sample at 
hand is presumed to be representative. 


Data are organized in arra 
cal order. Data are often 
analysis is simplified and ch 

Measures of central tende; 
data in terms of some Sort o 


ys in ascending or descending numeri- 
grouped into class intervals, so that 
aracteristics more readily noted. 

ncy (mean, median, and mode) describe 
£ average. Measures of position, spread, 


ange, deviation, standard deviation, per- 
centile, sigma score, and standard score are useful measures of 


position, spread, or dispersion. 

Measures of relationship describe the relationship of paired varia- 
bles, quantified by a coefficient of correlation. The coefficient is 
useful in educational research in standardizing tests and in making 
predictions when only some of the data are available. It should be 
noted that a high coefficient does not imply a cause-effect relation- 
ship, but merely quantifies a relationship that has been logically 
established, prior to its measurement, 

Statistics is the Servant, not the master, of logic; a means, not 
an end, of research. ,, Unless basic assumptions are valid, the right 


data are carefully gathered, recorded, and tabulated, and the an 
sis and interpretation are lo 


in the search for truth, 


aly- 
gical, statistics can make no contribution 
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THE RESEARCH REPORT 


WHILE RESEARCH REPORTS MAY DIFFER CONSIDERABLY 
in scope of treatment, they are expected to follow a similar pattern 
9f style and form that has become conventioyal in academic circles. 
These matters of style and form may seem unduly arbitrary to the 
Student. However, they are based upon principles of clarity of 
Organization and presentation, and it is essential that the graduate 
Student in education be familiar with them, if he is to communicate 


his ideas effectively. 
249 
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STYLE MANUALS 


Some graduate schools or departments have designated an offi- 
cial manual, or have established their own style manual, to which 
their theses or dissertations must conform. The student should find 
out which manual has been adopted officially by his institution or 
department. Beginning graduate students are disturbed when they 
discover that these manuals are not 
on matters of typography or forma: 
ever, will reveal the fact that diff 
In general, they 
presentation. 

Regardless of whi 


always in complete agreement 
t. Careful examination, how- 
erences concern minor details, 
are in basic ageement on Principles of correct 


ch manual is used as a guide, it should be 
followed Consistently in matters of form and style. The presenta- 


tion: of this chapter is Consistent with severa] of the widely used 
form and style manuals,1 


, a 
FORMAT OF THE RESEARCH REPORT 
The research report, whether it be "a thesis, dissertation, or a 
T or report, usually follows a f 


airly standardized 
lowing outline presents the 


pattern. The fol usual sequence of 


topics: 


A. Preliminary Section or Front M 
I. Title Page 
2: Acknowledgement (if any) 
3. Table of Contents 
4. List of Tables (if any) 
5. List of Figures (if any) 

B. Main Body of the Report 
1. Introduction 


atter 


j .; also Kathleen Dugdale, A Manual of 
Form for Theses and Term Reports ( Bloomington, Indiana: Indiana University 
Bookstore, 1955 ), 58 pp. 
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a. Statement of the problem—specific questions to be an- 
swered 
. Significance of the problem 
. Purposes of the study 
. Assumptions and limitations E 
. Definition of important terms. 
2. Review of Related Literature or Analysis of Previous Re- 
search 
3. Design of the Study 
a. Procedures used 
b. Sources of data 
c. Methods of gathering data 
d. Description of data-gathering instruments used 
4. Presentation and Analysis of Data 
a. Text 
b. Tables 
c. Figures 
5. Summary and Conclusions 
a. Restatement of the problem’ 
b. Description of procedures used 
c. Principal findings and conclusions 
d. Recommendations for further research 
C. Reference Section 
1. Bibliography 
2. Appendix 


e o PTA e c 


Preliminary section 


The first page of the report is the title page. While title page 
forms differ from one institution to another, they usually include: 
(1) the name of the topic; (2) the name ofthe author; (3) the 
relationship of the report to a course or degree requirement; (4) the 
name of the institution where the report is to be submitted; and 
(5) the date of presentation. 

The title should be concise and should indicate clearly the pur- 
poses of the study. It is well to keep in mind its possible useful- 
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ness to the reader who may scan a bi 
be listed. The title should not claim 
actually delivers. 


bliography in which it may 
more for the study than it 
It should not be stated so broadly that it seems 
to provide an answer that cannot be generalized, either from the 


data gathered or from the methodology employed. For example, 


THE TELEVISION 
OF A GROUP OF FIFTH 
GRADE PUPILS 


VIEWING HABITS 


by 


Sarah L. Jones 


A Term Report Submitted 1 
of the Requirements in 


n Partial Fulfillment 


` 


Education 548: The identirs 


cation and Analysis 
of Educational Problems 5 


College of Education 


BUTLER UNIVERSITY 


January 26, 1958 


Fig. 10-1. 


WM Lm 
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if a study were made of the salaries of teachers enrolled in a par- 
ticular class, the title should not read, “The Salaries of Teachers” or 
‘The Salaries of Teachers in Indiana.” A more appropriate title 
would be “The Salaries of a Group of Teachers Enrolled in a Class 
at Indiana University.” i 

The title should be typed in capital letters, double-spaced, and 

centered between the right and left margins of the page. Where 
more than one line is required, the words in the title are divided 
into lines so that each successive line is shorter than the one above 
it and is centered below it in an inverted pyramid style. This 
format is also used for table titles. Figure 10-1 illustrates a sample 
Page used for a research report, submitted in partial fulfillment of 
the requirements of a course. 
_ An acknowledgement page is included if the writer has received 
unusual assistance in the conduct of the study. If used, acknowl- 
edgements should be simple and restrained. Flattery and effusive 
Tecognition for routine participation by members of the writer's 
family, faculty advisers; librarians, and clerical helpers are consid- 
ered unnecessary and in poor taste. 

Table of contents. A good table of contents serves an important 
Purpose in providing an outline of the contents of the report. The 
relationship between principal and minor divisions is indicated by 
Capitalization of chapter numbers and titles, with subheadings in 
Small letters and with capitalized principal letters. Page references 
for each topic are indicated. 

List of tables and figures. If tables and figures are included in 
the report, a separate page is included for each list. All pages of 
the preliminary section of the report are numbered with small 
Roman numerals (i, ii, iii). 


ey 


The main body of the report 


This section may be divided into five divisions. In a thesis or 
a dissertation these divisions may comprise chapters. In a shorter 
term paper or report they may consist of sections appropriately set 
off by centered headings. 
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1. The first section serves as an introduction to the area of con- 
sideration. A clear statement of the problem with specific questions 
to be answered is presented first. A consideration of the sig- 
nificance of the problem and its historical background is also appro- 
priate. Specific purposes of the study are described, and all as- 
sumptions and limitations are recognized. All important terms are 
carefully defined, so that the reader may understand the concepts 
underlying the development of the investigation. 

2. The second section reviews the important literature related 
to the study. Previous research studies are abstracted, and sig- 
nificant writings of authorities in the area unde 
This part of the research report provides a 
development of the present study 
Since good research is based upo 
a problem, this part of the repor 
tor's knowledge of the field. 


3. The third section explains the design of the study. Procedures 
that are used are described ip detail. Sources of data 
methods of gathering data are ex 
ments used are desc 
bility. 

4. Section four includes the presentation and analysis of the 
data. This is the heart of the research report. Through textual 


discussion and tabular and graphic devices, the data are critically 
analyzed and reported. 


r study are reviewed. 
background for the 
and brings the reader up to date. 
n everything that is known about 
t gives evidence of the investiga- 


are identified, 
plained, and data-gathering instru- 
ribed and evaluated for validity and relia- 


5. The fifth section of the report consists of the summary. "After 
a brief restatement of the problem and a brief description of the 
procedures used, the principal findings and conclusions are pre- 
sented. These conclusions represent the most significant results 
of the investigation. „It is appropriate in this section for the investi- 
gator to indicate promising side problems that have been uncovered, 
and to suggest promising areas for further research, 

The summary and conclusions section is the most utilized part 
of a research report. Readers who sc: 
sible significant information fre 
the study. 


an research reports for pos- 
quently refer only to this section of 
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Reference materials 


l. The bibliography is preceded by a sheet containing the word, 
BIBLIOGRAPHY, capitalized and centered on the page. The first page 
of the bibliography has the center title, srstiocrapHy. References 
are arranged in alphabetical order, the last name of the author listed 
first. Each entry is placed flush with the left margin of the page, 
and subsequent lines are single-spaced and indented five spaces. 
A double space separates entries. If no author name is given, the 
name of the publication or the sponsoring organization is listed as 
the author. 3 

In a short bibliography, books, pamphlets, monographs, and peri- 
odical references may be eombined in the same list. If the num- 
ber of references is large, the bibliography may be divided into sec- 
tions, one for books, one for periodicals, and possibly one for special 
documents. Ordinarily, a selected bibliography is preferable to 
an exhaustive list. An annotation, or short statement giving the 
reader a clear idea of the nature of the reference and the topics that 
it covers, adds an important quality of usefulness to the bibliography. 
The annotating statement should be single-spaced, but separated 
from the bibliographic entry by a double space. 


Bibliographic Entry and Annotation 
Lieberman, Myron. Education as a Profession. Englewood Cliffs, N. J.: 

Prentice-Hall, Inc., 1956. 540 pp. 

An objective and penetrating analysis of the historical and philosophi- 
cal bases of teaching. Preparation, accreditation and certification, quality 
Of teaching personnel, professional organizations and their activities, and 
teacher status are examined, and comparisons are made with law, medi- 
Cine, and the other recognized professions. 


2. The appendix is preceded by a sheet containing the word, 
APPENDIX, capitalized and centered on the page. The first page of 
the appendix is titled APPENDIX A, and pages are numbered serially, 
Using Arabic numerals. Tables and data—important, but not essen- 
tial to the understanding of the report—copies of cover letters used, 
and printed forms of questionnaires, tests, and other data-gathering 
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devices may be placed in the appendix. Each separate entry head- 
ing is listed as APPENDIX A, APPENDIX B, etc. 

In mounting pictures, standard forms, and other materials on 
the manuscript sheet stationers rubber cement should be used. 
The materials to bz joined should each be coated and allowed to dry 
before being pressed together. The result will be a permanent 
bond that will not cause the paper to wrinkle. 


STYLE OF WRITING 


"The research report should be presented in a style that is crea- 
tive, clear, and concise. While the phraseology should be dignified 
and straightforward, it need not be dull or pedantic. 
profound ideas can best 
coherent sentences. 

Slang, hackneyed, or flippant phrases and folksy style should be 
avoided. Since objectivity is the primary goal, there should be no 


The research report should 


Even the most 
be explained in simple language and short, 


feature article, 
In the interests of objectivity the personal pronouns, I, we, you, 
my, our, and us should not be used. These personal Pronouns can 
be avoided by the use of such expressions as “the investigator” or 
“the researcher,” Instead of saying, “I selected ten students from 
each class,” the passive voice construction would be preferable—"Ten 
students were selected from each class.” 

The past tense should be u 

that have been completed, 

Abbreviations should not be used in the text of the research report. 
Except as used in Ícotnotes, bibliography, and tables, only a few 
abbreviations are considered appropriate. If there is any doubt, 
words should be spelled out. 

Numbers beginning a sentence should be spelled out. Fractions, 
round numbers, and numbers under one hundred should be spelled 
out, except when they are combined (use one half, but 414). 
Per cent should be spelled out, except in tables and figu 


sed in describing research procedures 


res, Num- 


| 
[ 
: 


THE RESEARCH REPORT 257 


bers used with the word per cent should not be spelled out (18 
Per cent) unless they begin a sentence, In numbers with more 
than four digits commas should point off thousands or millions 
(1353; 13,530). 


Correct vsage 


Of course, the ordinary rules of correct usage should prevail. A 
good dictionary, a handbook of style, and Roget's Thesaurus are 
helpful references for correct spelling, syllabication, grammatical 
construction, and the appropriate use and variation of words and ` 
expressions. 

The author has noted frequent errors of spelling, agreement be- 
tween subject and predicate, nonparallel construction, and. incon- 
sistent tense sequence. Students who have difficulty in written 
expression should have a competent friend or relative proofread 
their copy for correct usage before they type the final manuscript. 
Inability to write correctly is a serious limitation. Carelessness is 


an even greater fault. 

Effective research report writing is not an easy task, Good 
reports are not written hurriedly. Even skillful and experienced 
writers revise many times before they submit a manuscript for pub- 


lication. 


TYPING THE REPORT 


Many students type their own term papers or research reports. 
Anyone witl: reasonable proficiency and a willingness to learn 
proper procedures can do an acceptable job. Typographical stand- 
ards for the thesis or the dissertation are more exacting. Strike- 
overs, crossoyers, insertions, and erasures are not nermitted. There- 
fore, only typists with great proficiency should attempt to prepare 
thesis or dissertation copy. While the expense of professional 
typing may seem high, the saving of time and excessive effort usu- 
ally makes this arrangement the wiser choice. 

It is the writer’s responsibility to present manuscript material to 
the professional typist in proper form. Except for minor typo- 
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graphical matters, the correction of major errors is not the responsi- 
bility of the typist. After the material is received fom the typist, 
the student should proofread it carefully before it is turned in. 


Typography 


1. One hundred per cent tag-content, white paper, 8/4 by 11 
inches in size, of thirteen to sixteen pound weight, should be used 
for the original and first carbon copy of the thesis or dissertation. 
Adighter paper may be used for additional copies. For the term 
Paper any good bond paper is acceptable. Only one side of the 
sheet is used in typewritten manuscript. Lud 

2. Pica type, with ten spaces to the inch, is preferred to elite, 
which has twelve. The type must be clean, and a medium-inked 
black ribbon should be used. Medium-weight, black carbon paper 
should be used for the copies. Carbon paper should be replaced 
often enough to insure clear and even copies. Special symbols not 


available on the typewriter keyboard should be carefully inserted, 
using black India ink. 


3. To facilitate the proper 


placement of Copy on the page a 
guide sheet may be constructe 


d, showing the proper margins, the 
center of the copy portion, and the number of lines from the top 


and bottom margins, This sheet should be ruled in black India 
ink and placed beneath the first sheet, so that the markings show 
through. The use of the Euide sheet takes much of the "guess- 
Work" out of copy placement. (See Figure 10-2.) Also helpful is 
Multicopy carbon Paper, which has in the margin a numbered scale 
tepresenting single-spaced lines, 

4. The right ‘mar 
inches, the bottom 
inches. 

5. Textual material should 
between the paragraphs, 
spaced, 

6. Paragraphs should be ind 
nine for elite, 


gin should be one inch, the top margin 1144 
margin 1% inches, and the left margin 114 


be double-spaced, with triple-spacing 
Long lists of materials may be single- 


ented seven spaces for pica type, 
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7. Words should not be divided at the end of the line, unless 
completing them would definitely interfere with the margin. A 
few spaces runover is preferable. In dividing words a dictionary 
should be consulted for correct syllabication. 


Fig. 10-2. 


8. Direct quotations not over three typewritten lines in length 
are included in the text and are enclosed in quotation marks. 
Quotations of more than three lines are set off from the text in a 
single-spaced paragraph and indented three spaces from both left 
and right margins without quotation marks. Original paragraph 
indentations are retained. b 

9. The superscript is ordinarily placed at the end of the sentence 
of quoted material. Where several references are mentioned in 
one sentence, the superscript is placed after ẹach name reference 
(Smith, Jones,? and Brown ? reported their findings). 


FOOTNOTES 


Footnotes serve a number of purposes. They enable the writer 
to substantiate his presentation by citations of other authorities, to 
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give credit to sources of material that he has quoted or paraphrased, 
and to provide the reader with specific sources that he may use to 
verify the authenticity and accuracy of material used. 

Occasionally, in research report writing the footnote is used to 
present explanatory statements that, while important, would inter- 
fere with the logic and continuity of textual material. In serving 
these purposes footnotes are very useful devices, They should be 
used sparingly, however, and never included for 
of scholarly appearance. 

Footnote citations are placed at the bottom of the page, and 
are separated from the text by a two-inch horizontal line drawn 


the mere purpose 


Spaces. If there is a second line 
left margin. 

Footnotes are single-spaced, wW. 
tions. Footnotes are numbered 


In consecutive footnote reference the abbreviation Ibid. (Latin, 


the same) may be used. If the page reference is different, the new 
page citation follows: 


? Pauline V, Young, Scientific Social Surveys and Research  ( Engle- 
wood Cliffs, N, Jz Prentice-Hall, Inc., 1949), PAINE tr 
4 Ibid. (Indicates same page as previous reference. ) 


č Ibid. p. 232. . (Same work, but a different page.) 


name of the author and the pa 
another reference intervenes, 


1 Francis G, Cornell, The Essentials of Educational Statistics (New 
York: John Wiley and Sons, Inc., 1956), p. 21. 
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? Lester Guest, Beginning Statistics. (New York: Thomas Y. Crowell 
Co., 1957), p. 11. 
3 Cornell, op. cit. p. 34. 
When a second but nonconsecutive reference follows referring to 


the same work and same page previously cited, loc. cit may be used. 
Again, the author's surname always must be included. 


* Guest, loc. cit. (This reference is to page 11.) 


Abbreviations 


In bibliography or footnote references abbreviations may be used 
to conserve space. Students should be familiar with the following 
standard abbreviations: 


art., arts. article, articles 
bk., bks. book,. books 
C. (circa) about (approximate date) 
cf. E compare 
chap., chaps. chapter, chapters 
col, cols. column, tolumns 
div., divs. division, divisions 
ed., eds. e editor, editors 
ed., edd. edition, editions 
et al. and others 
e.g. for example 
et seq. and the following 
TED: and the following 
fig., figs. figure, figures 
ibid. same reference 

` idem. same person 
ie., that is 
illus. illustrated 
infra. below 
jail line, lines 
loc. cit. the place cited 
mimeo. mimeographed 
ms. manuscript 
n.d. no date given 
n.n. no name given 
n.p. no place given 


number, numbers 
previously cited 
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P. pp. page, pages 

par., pars. paragraph, paragraphs 
passim here and there (scattered) 
pt. pts. part, parts 

rev. revised 

Sec. secs. . section, sections 

sic. thus 

supra. above 

trans, translated 

vide. see 

vol., vols, volume, yolume 

(ene) Omissions in quoted matter up to 


One paragraph in length—(for a 
full paragraph or more omitted, 
use a full line of alternating 
periods and spaces). 


BIBLIOGRAPHY AND FOOTNOTE FORM 


The purpose of the bibliography is quite different from that of the 
footnote. The bibliography, located at the end of the main body 
of the report, lists, in alphabetical order, the ‘references used by the 
writer in Preparing the report. The footnotes, found at the bottom 


of the page, Specifically cite the exact place where quoted or para- 
phrased materials may be found, 


The typographical form of 
note citation also differ. Not 
trate the differences for a text! 


the bibliography listing and the foot- 
e the following examples which illus- 
book reference: 


Bibliography 


Campbell, William Giles, Form and Style in Th 


esis Writing. Boston: 
Houghton Mifflin Co. 1954. 114 pp. ‘ 


Footnote 


1 William Giles Campbell, Form and Style in Thesis Writing (Boston: 
Houghton Mifflin Co., 1954), p. 24, 


Table 10-1 summarizes the differences in bibliography and footnote 
form, 


B 
s 


-n 
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TABLE 10-1 


A COMPARISON OF BIBLIOGRAPHY : 
AND FOOTNOTE FORM 


Bibliography © Footnote 


Indentation ae line flush} regular paragraph in- 
with margin, second line in- | dentation 
dented five spaces 


Name order last name first (of first author | first name first 
when more than one author) 


Placement end of body of report—listed| 1 bottom of page suh 
alphabetically by last name of | superscript 
first author 


Punctuation Author name. Title, Place of 1 Author, Title (Place 
publication: Publisher, date|of publication: Publisher, 
of publication. date of publication). 
EET E 
Page reference 414 pp. (total number of pages | p. 23. (specific page loca- 
in book or in article) tion of reference) 


LU F 
Additional forms, both bibliography and footnote, most often used 
in educational writing are illustrated for each type of reference. 


Joint authors 


Bibliography Form: 

Good, Carter V., A. S. Barr, and Douglas E. Scates. The Methodology 
of Educational Research. New York: Appleton-Century-Crofts, Inc., 
1941. 890 pp. 

Footnote Form: 

1 Carter V. Good, A. S. Barr, and Douglas E. Scates, The Methodology 
of Educational Research (New York: Appleton-Century-Crofts, Inc., 


1941), p. 75. 
More than three authors 
Bibliography Form: 


Stanley, William O. et. al. Social Foundations of Education. New 
York: The Dryden Press, Inc., 1956. 638 pp. 
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Footnote Form: 


1 William O. Stanley et. al., Social Foundations of Education (New 
York: The Dryden Press, Inc., 1956), p. 24. 


Editor as author 


Bibliography Form: 

Buros, Oscar K., ed. The Fourth Mental Measurements Yearbook. 
Highland Park, N, J.: Gryphon Press, 1953. 1163 pp. 

Footnote Form: 


1 Oscar K, Buros, ed., The 


Fourth Mental Measurements Yearbook 
(Highland Park, N. J.: Grypho; 


n Press, 1953), p. 179. 
Author not given 


Bibliography Form: 
Author's Guide, 


Englewood Cliffs, N. J.: Prentice-Hall, Inc, 1955, 191 
. pp. » 


Footnote Form: 


1 Author's Guide (Englewood Cliffs, N. J: 
23. 


Prentice-Hall, Inc., 1955), 
P. 


Publication of an association, agency, or society 


Bibliography Form: 


Modern Philosophies of Zducation, National Society for the Study of 
Education, Fifty-fourth Yearbook, Part I, Chicago: The University of 
Chicago Press, 1955, 374 pp. 


or 
National Society for the Study of Education, Modern Philosophies of 
Education, Fifty-fourth y, 


earbook, Part T. Chicago: The University 
of Chicago Press, 1955. 374 pp. 


d THE RESEARCH REPORT 265 


Footnote Form: 

1 Modern Philosophies of Education, National Society for the Study of 
Education, Fifty-fourth Yearbook, Part I (Chicago: The University of 
Chicago Press, 1955), p. 220. Quoted by permission of the Society. 
(This particular organization asks for the inclusion of “Quoted by permis- 
sion of the Society.” Some organizations and publishers request certain 
forms of acknowledgement when materials are quoted in the thesis, dis- 
sertation, or for a manuscript to be published in a book or periodical. For 
term papers, permission to quote is not necessary.) 


Part of a series 


Bibliography Form: 

Terman, Louis M. and Melita H. Oden. The Gifted Child Grows Up. 
Vol. IV of the Genetic Studies of Genius Series, ed. Louis M.Terman, 
Stanford: Stanford University Press, 1947. 448 pp. 


Footnote Form: 

1 Louis M. Terman and Melita H. Oden, The Gifted Child Grows Up, 
Vol. IV of the Genetic Studies of Genius Series, ed. Louis M. Terman, 
4 vols. (Stanford: Stanford University Press, 1947), p. "m 


A chapter written by an author other than the author or 
editor of the book 


Bibliography Form: 

Andrews, Paul O. “Guiding Pupil Behavior,” Chapter XVI in The Stu- 
dent Teacher in the Secondary School. Paul R. Grim and John W. 
Michzelis, eds. Englewood Cliffs, N. J.: Prentice-Hall, Inc., 1953. 


Footnote Form: 

1 Paul O. Andrews, 
Student Teacher in the Secondary Schoo 
Michaelis, eds. (Englewood Cliffs, N. J.: Prenti 
320. 


“Guiding Pupil Behavior,” Chapter XVI in The 
l, Paul R. Grim and John W. 
»e-Hall, Inc., 1953), p. 


Article in an encyclopedia 


Bibliography Form: 
"New Harmony," Encyclopedia Britannica (1958 rev.) XVI, p. 305. 
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Footnote Form: 
1"New Harmony," Encyclopedia Britannica (1958 rev.) XVI, p. 305. 


Periodical article 


tuation differences, 


Bibliography Form: 


Walsh, J. Hartt, “Education in 2,000 A.D.,” Nation’s Schools, 57:47-51, 
April, 1956, 


Footnote Form: 


J. Hartt Walsh, “Education in 2,000 A.D.,” Nation’s Schools, 57:50, 
April, 1956, 


Quotation from a Primary source that cannot be located 


When using a quotation fr 
author, try to find the origina] Source and quote it directly, If you 


Kelly, Ear] P, "Education for What is Real" New York: Harper & 
Brothers, 1947, As cited by Edward A. Krug, Curriculum Planning. 
New York: Harper & Brothers, 1950, p. 55. 

Footnote Form: 


Earl P. Kelly, “Education for What is Real,” 
Brothers, 1947. As cited by Edward A. Krug, 
(New York: Harper & Brothers, 1950), p. 55. 


New York: Harper & 
Curriculum. Planning 


Newspaper articles 


Bibliography Form: 
Editorial in The Indianapolis News, January 6, 1959, 


Associated Press Dispatch, The Milw 


aukee Journal, December 24, 1958. 
p.1 
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The Chicago Daily News, February 3, 1959. p. 6. 
Campbell, Don G. “Basketball Needs Cash,” The Indianapolis Star, 
March 2, 1958, Section 3, p. 1. 


Footnote Form: 

1 Editorial in The Indianapolis News, January 6, 1959. 

1 Associated Press Dispatch, The Milwaukee Journal, December 24, 
1958. p. 1. 

1 The Chicago Daily News, February 3, 1959, p. 6. A 

1 Don G. Campbell, “Basketball Needs Cash,” The Indianapolis Star, 
March 2, 1958, Section 3, p. 1. 


Unpublished materials 


Bibliography Form: 

Devoe, Donald B. Bibliography on Uses of High Speed Computers in 
Psychology. Medford, Mass.: Tufts University. Institute for Ap- 
plied Experimental Psychology, 1957. 5 pp. (Mimeographed). 


Footnote Form: 

1 Donald B. Devoe, Bibliography on Uses of High Speed Computers 
in Psychology (Medford, Mass.: Tufts University, Institute for Applied 
Experimental Psychology, 1957), (Mimeographed) p. 2. 


Thesis or dissertation 


Bibliography Form: 

Best, John W. An Analysis of Certain Selected Factors Underlying the 
Choice of Teaching as a Profession. Unpublished Doctoral Disserta- 
tion, “Iniversity of Wisconsin, Madison, 1948. 


Footnote Form: 

1John W. Best, An Analysis of Certain Selected Factors Underlying 
the Choice of Teaching as a Profession (Unpublished Doctoral Disserta- 
tion, University of Wisconsin, Madison, 1948), p 14. 


Many dissertations are now reproduced in microfilm form. 


Porter, Robert M. Relationship of Participation to Satisfaction in Small 
Group Discussions. Doctoral Dissertation. Philadelphia: Temple 
University, 1955. 143 pp. 

Abstract. Dissertation Abstracts 15:2492-93; No. 12, 1955. 
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Speeches or statements made, but not published, are listed in the 
footnotes but not in the bibliography. When quoted in published 


1 Statement by Paul Butler, personal interview, January 17, 1958, 


1 Commencement address, Butler University, Indianapolis, Indiana, 
- June 6, 1958, 


Quotations from letters 
A letter is legally the Property of the writer, not the recipient. 
When contents are quoted, the written Permission of the writer or, 


if deceased, the Permission of his heirs, is necessary. 


1 Letter, Henry R. Smith to Paul T. Jones, December 7, 1958. 


HEADINGS 


title is centered 


w the heading. Textual ma- 
terial follows three spaces below the title, 
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CENTER HEAD 


Side head 


Paragraph side head. 


PAGINATION 


Page numbers are assigned to each page of the paper or report. 
The title page or the initial page of a section (chapter, major sub- 
division, bibliography, or appendix) does not have a page number 
typed on it, but a number is allowed for it in the series. 

Page numbers are placed in the upper right-hand corner, one 
inch below the top of the page and aligned with the right margin. 
Page numbers of the preliminary section of the manuscript use small 
or lower-case Roman numerals (i, ii, iii), beginning with the title 
page and ending with the last page preceding the main body of the 
paper. The page containing Chapter I is page 1, but has no num- 
ber typed on it. However, the next page is page 2, The bibliog- 
raphy and appendix are numbered serially and consecutively, fol- 
lowing the last chapter. ` 

Since correct pagination depends upon the final edited copy, as- 
signing page numbers should be the final step before putting the 
manuscript into the binder or folder. Preliminary page numbers 


can be lightly penciled in and changed, if additions, deletions, or 


corrections are made. 
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TABLES 


A table is a systematic method o£ presenting statistical data in 
vertical columns and horizontal rows, according to some classifica- 
tion of subject matter. Tables enable the reader to comprehend 
and interpret masses of data rapidly, and to grasp significant details 
and relationships at a glance. 

Good tables are relatively simple, concentrating on a limited 
rumber of ideas, Including too much data in a table minimizes the 
value of tabular presentation. Rather than include too many de- 
tails, it is often advisable to use several tables. It has been said 
that the mark of a good table is its effectiveness in conveying ideas 
and relationships independently of the text of the report. 

If a table is large enough to occupy more than a half-page, it 
should be placed on a page by itself, carefully centered for a bal- 
anced effect. If it is short, occupying less than a half page, it 
may be placed on the Page with textual material, preferably follow- 
ing as closely as Possible the textual discussion that relates to it. 

Text references should identify tables by number, rather than by 
such expressions as, “the table above,” or “the following table.” 


the top of each column of data on each page. 

Tables should not exceed the page size of the manuscript. Large 
tables that must be folded into the copy are always cumH€rsome, 
and cannot be easily refolded and replaced. Large tablés should 
be reduced to manuscript page size by photostating or some other 
Process of reproduction. Tables that are too wide for the page 
may be turned sidewise, with the top facing the left margin, or 
binding, of the manuscript. 

The word TABLE is centered between the page margins and typed 
in capital letters, followed by the table number in capital Roman 
numerals, Tables are numbered consecutively throughout the en- 
tire report or thesis, including those tables that may be placed in 
the appendix. The caption or title is placed two spaces below the 
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Word TABLE, and arranged in inverted pyramid form. No terminal 
punctuation is used. The main title should be brief, clearly indi- 
gaung the nature of the data presented. Occasionally, a subtitle 
£ used to supplement a briefer main title, denoting such additional 
information as sources of data and measuring units employed. 

. Because they are completely unnecessary, such expressions as 
‘table showing,” “distribution of,” or “frequency of” should be 
avoided. 

The top of the table is placed three spaces below the last line 
of the title. Column headings, or box heads, should be clearly 
labelled, describing the nature and units of measure of the data 
listed, Such terms as number, per cent, and frequency may be 
abbreviated by the use of No., %, and f. 

If numbers are shortened by the omission of zeros, that fact 
should be mentioned in the subtitle (in millions of dollars—in 
thousands of tons). The stub, or label, for the rows should be clear 
and concise, parallel in grammatical structure, and if possible, no 
longer than two lines. 

Numerical data are usually arranged in descending order of 
magnitude or frequency, so that comparisons by position can be 
noted readily. If there are'several columns in the table, the first 
column to the left is arranged in descending order. When data are 
presented by states, the material is sometimes listed alphabetically 
by states to facilitate location. Lines of tabular data are single 
spaced. Rulings or lines are used only if they facilitate the read- 
ing of the table. Few horizontal lines are needed. Vertical lines 
at lett and right margins are omitted. 

Decimal points should always be aligned in the column. When 
no data are available for a particular cell, indicate the lack by a 
dash, rather than by a zero. Double horizontal lines are placed 
at the top of the table separating it from the title. A horizontal line 
is also placed at the bottom to separate the table from the material 
which follows three spaces below. 

When footnotes are needed to explain items in the table, small 
Arabic letters or typewriter key symbols are used. Numerical 
superscripts would be confused with the data contained in the table. 


272 THE RESEARCH REPORT 
Table footnotes are placed just below the table, rather than at the 
bottom of the page. 

TABLE X 


OCCUPATIONS OF FATHERS OF UNIVERSITY 
OF WISCONSIN SENIORS PREPARING 
TO TEACH ° 


Occupations Men Women 


No. % No. 261 
dá PIS OS 

Business proprietor 24 23 32 29 
Skilled labor 19 18 19 9 
Farming 17 17 19 17 
Clerical-sales 16 16 18 16 
Profession 15 15 20 18 
Unskilled labor 6 6 6 5 
No data 5 5 7 6 

Total 102 100 112 100 


t Percentages rounded to equal 100% 


° Adapted from John W. Best, “An Analysis of 
derlying the Choice of Teaching 


Sertation, University of Wisconsin, 


Certain Selected Factors Un- 
as a Profession. \ Unpublished Doctoral Dis- 
, Madison, Wisconsin, 1948), p. 47, 


Fig. 10-3. 


FIGURES 


A figure is a device that presents statistica] data in graphic form. 
The term figure is applied to a wide variety of graphs, charts, maps, 
Sketches, diagrams, and drawings. When skillfull 


relationships, 3 
Many of the qualities that were listed as characteristics of good 
tables are equally appropriate when applied to figures. 


1. The title should clearly describe the nature of the data pre- 
sented. 


2. Figures should be simple enough to convey a clear idea, and 
be understandable without the aid of textual description. 


3. Numerical data upon which the figure is based should be 
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presented in an accompanying table, if it is not included in the 
figure itself. 

4. Data should be presented carefully and accurately, so that 
oversimplification, misrepresentation, or distortion do not result. 

5. Figures should be used sparingly. Too many figures detract 
from rather than illuminate the presentation. 

6. Figures that occupy more than a half-page should be placed 
on a separate page. Those that are smaller and occupy less than 
a half-page may be placed on the same page as textual material. 

7. Figures should follow, never precede, the related textual 
discussion. i 

8. Figures are referred to by number, never as “the figure above” 
or “the figure below.” 

9. Figures are numbered with Arabic rather than Roman 
numerals. 

10. The title of the figure is placed below rather than above it. 
There are four acceptable and frequently used title forms, any 
of which may be used if followed consistently throughout the 


report. r 
1. Paragraph form 3 
Figure 1. Absences of students at Washington School during Novem- 
ber, 1959. 
2. Underhung form 


Figure 1. Absences of students at Washington School during Novem- 
bei, 1959. 


3. Block form 
Figure 1. Absences of students at Washington Schooi during November, 
1959. ? 


4. Inverted pyramid form 
Figure 1. 


Absences of Students at Wash- 
ington School During 
November, 1959 
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The line graph 


The line graph or chart is especially useful in making predictions 
based upon trends, and in presenting relationships between several 
types of data. Changing status with the passing of time, or the 
relationships between variables, can be plotted on.the vertical and 
horizontal axes. 

The horizontal axis usually measures the independent variable; 
the vertical axis the measured characteristic. Graphic arrangement 
should proceed from left to right on the horizontal axis, and from 
bottom to top on the vertical. The zero point should always be rep- 
resented, and scale intervals should be equal If a part of the scale 


is omitted, a set of parallel jagged lines should be used to indicate 
that part of the scale omitted, 


100 
90 
80 
70 
10 


1945 1950 1955 1960 


When coordinate graph paper is used, the lin 
intersecting points should be made heavy eno 
them from the rulings on the paper. 


es conneccing the 
ugh to distinguish 
When several lines are drawn, 
they may be distinguished by using various types of lines—solid, 
dotted, or alternate dots and dashes. Black India ink is used. 

A smoothed curve cannot be obtained by plotting any data di- 
rectly. Only when infinite data are obtained will the lines con- 
necting the points approach a curved line, The figure formed by 
the lines connecting the points is known as a frequency polygon. 

The ogive ( o-jive) is a curve that plots cumulative frequencies, 
usually converted into percentages. The vertical axis of the graph 
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is divided into 100 equal parts. The chief value of the ogive lies 
in the fact that percentile ranks may be read directly. In Fig. 
10-3 the salaries of public school teachers during the year 1955- 
56 are presented. The median or any other percentile point may 
be read directly from the ogive (Fig. 10-4). 4 

per- : 

cent 


100 


90 
80 
70 


60 


50 median $3955 
mean 4055 


4o 


30 
20 


10 


- 3,000- 4,000- 5,000- 6,000- 7,000 or 
2,000 — 2,999 3:999. 1:999 5,999 6,999 more 
Fig. 10-4. Salaries of public school teachers, expressed in cumulative 
percentages (1955-1956) (ogive]. 
i iati ivision, The Status 
Adapted from National Education Association, Research Division, T 

of the Um Public School Teacher. Washingtcn: The Association, 1957. 

P. 23. Used with permission. 


The bar graph or chart 
The bar graph may be arranged either horizontally or vertically, 
and represents data by bars of equal width, drawn to ee 
The numerical data may be lettered within the bar or outside g it. 
A grid may be used to help quantify the graphic representation. 


276 THE RESEARCH REPORT 


A divided bar graph represents the components of a whole unit in 
one bar. 


Core) 
sn] 


horizontal 


SSSSS 


vertical divided | 


When comparisons are made. 
trasted by crosshatchin 


pone [——] 94,500 
Private RNY 


_ 17,000 
62,500 Ó 
50,000 
51,030 
41,580 SS 
33,750 3 N 
public 26,836 NS 
l SS 
private 
N NN N N 


1953 1960 


1965 1970 
Fig. 10-4, Actual and Predicted enrollments for selected Indiana col. 
leges and universities [selected years]. 


Adapted from Looking to the Future of Education in Indiana, Indianapolis: 
Indiana State Chamber of Commerce, 1954, p. 9. 
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M ii cellophane tape with various designs—of stripes, dots, 
circles, and checks—has largely replaced the inking process, and is 
available at art supply stores.? , 

In bar graphs the bars are usually separated by space. If the 
graph contains a large number of items, the bars may be joined to 
save space, 

Horizontal bar graphs are usually used to compare components 
at a particular time. Vertical bars are used when making com- 
parisons at different times. 

In typed manuscript horizontal bars are easier to construct. Be- 
cause of space limitations and typing problems, vertical bars afe 
difficult to label. 


The circle, pie, or sector chart 


This type of chart shows the division of a unit into its component 
parts. It is frequently used to explain how a unit of government 
distributes its share of the tax dollar, how an individual spends his 
salary, or any other type of simple percentage distribution. 

The radius is drawn vertically, and components are arranged in 
a clockwise direction in descending order of magnitude. The pro- 
portion of data is indicated by the number of degrees in each seg- 
ment of the 360? circle. 

This kind of data should be typed or printed within the segment 
if possible. If there is not sufficient room for this identification, a 
small arrow should point from the identification term to the seg- 
ment. \: 


Maps 

When geographic location or identification is important, maps 
may be used. Printed outline maps in 8% x 11 inch size are avail- 
able at school-supply stores. Identification may be made by the use 
of dots, circles, or other symbols, and density or characteristics of 
areas represented by shading or crossshatching. A key or legend 
should always be supplied if shadings are used. 


2 Available from Chart-Pak, Inc., Leeds, Mass. 
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Earnings of institutions 
and properties 


Aid from state Property tax 


and federal 
governments 


59% 
32% 


Fig. 10-5. Revenue of Indiana local governments, 
Adapted from An Economic Portrait of Indiana in 1970: Indiana’s Economic 
Resources and Potential, Bloomington, Ind.: School of Business, 


Indiana Uni- 
versity, 1950. p. 20, 


Organization charts 


To show staff functions, lines of authority, or flow of work within 
an organization, an organization chart is a helpful graphic “device. 

Units may be represented by circles, Squares, or obléngs, with 
names lettered within the units, Distinctions between direct and 
indirect relationships may be indicated by the use of solid and 
dotted lines, Ordinacily, authority, supervision, or movement of 
materials flow from the top to the bottom of the chart, but variations 
can be indicated by the use of arrows 


EVALUATING A RESEARCH REPORT 


Writing a critical analysis of a research report is a valuable ex- 
perience for the student of educational research, Reports for this 


NEW ENGLAND 
ASSOCIATION (6) 


dow 


EZ] 


SOUTHERN ASSOCIATION (11) __ 


COLLEGES AND SECONDARY SCHOOLS 


NOR 
OF co TH CENTRAL ASSOCIATION 


Fig. 10-6. Regional accrediting associations of colleges and secondary 
schools, with number of states in each association, and dates that asso- 
ciations were founded. z 


Map copyrighted by The George F. Cram Co., Inc., Indianapolis 7, Ind. 
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purpose may be taken from such periodicals as the Journal of 
Experimental Education, the Journal of Educational Research, or 
one of the many other publications that publish reports of research 
in education or in the closely related fields o 
ology. 

Another source is the unpublished research reports written by 
students in previous classes in educational research, or the theses 
or dissertations found in the university library. 

Through a critical analysis, the student may gain some insight 
into the"nature of a research problem, the methods by which it 
may be attacked, the difficulties inh 
the ways in which data are anal 
the style and form with which th 

The following questions are su 
the analysis: 


f psychology or soci- 


erent in the research process, 
yzed and conclusions drawn, and 
€ report is presented. 

ggested as a possible structure for 


1. What is the problem? 
a. Is it significant? 
b. Is it properly delimited? 
c. Are important implications recognized? 
2. What is the hypothesis? D 
a. Is it clearly stated? 
b. Does it seem to be logically based upon existing evidence? 
3. Are important terms clearly defined? 
4. What limitations are recognized? 
5. What sources of data are identified? A 
6. Is an adequate review of related literature presented?" - 
7. What research procedures are used? Are they described in 
detail? 
8. What data-gathering devices are employed? 
a. Are they appropriate? 
b. Are validity and reliability established? 
9. How are the data analyzed? 
10. What important conclusions are presented? 
a. Are they objectively stated? 
b. Are they justified by the evidence gathered? 
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1l. What recommendations or suggestions are made for further 
investigation? 
12, How would you evaluate the written report? 
a. Is the style clear, objective, and interesting? 
b. Is it consistent with proper standards of’ mechanical form? 
c. What tables and figures have been used to clarify the 
presentation? Do they present the data without distortion 


or misrepresentation? 
SUMMARY ; 


The research report is expected to follow the conventional pattern 
of style and form used in academic circles. While style manuals 
differ in some of the smaller details, the student is expected to be 
consistent in following either the pattern of style contained in the 
manual required by his institution, or the one that he is permitted 
to select. 

The style of writing should be cle: 
objective. Of course, the highest stan 
expected, and careful proofreading is necessary 
report is submitted. 3 

The use of tables and figures may h 
the data clear. They should be prese 
form, and should be carefully designed to present an 
undistorted picture. 

The evaluation of a resear 


ar, concise, and completely 
dards of correct usage are 
before the final 


elp to make the meaning of 
nted in proper mechanical 
accurate and 


ch project is a valuable exercise for 


the student of educational research. Using a pattern such as the 


one suggested, the critical analysis of the many aspects of another 
researcher's report helps the student to develop competency in his 


own research and reporting skills. 
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SOME SIGNIFICANT RESEARCH STUDIES 


G 


“6 


IN THE FIELD OF RESEARCH THERE HAVE BEEN MANY 
significant studies relating to education. To choose the most impor- 
tant or the best designed study would be a controversial, if not 
impossible, task. Of a large number that might have been chosen, 
three studies of note have been selected to illustrate the ways in 
which research procedures have been employed to throw new light 
on the nature of the learner and the learning processes. 
283 


284 some SIGNIFICANT RESEARCH STUDIES 


While these studies are, in a sense, 
they are not presented as perfect 
The researchers themselves would have been the last to claim per- 


fection, the first to recognize their limitations. These reports were 
designed and carried out with such imagination and skill, how- 
ever, that they may well serve as examp 


les of good. research, adding 
much to understanding of the possibilities of research in education. 


Each of the studies focuses upon a clearly defined and significant 
problem, follows a carefully designed plan, expertly gathers, 
analyzes, and interprets data, and objectively reports conclusions. 
The studies attempt to identify and measure certain elusive char- 
acteristics of individuals and their behavior. Each study was 
directed by experts working with a competent staff of investigators. 
Each study was extensive, dealing with a large number of individ- 
uals over a substantial period of time, and cov 
graphic area. 


models of research procedure; 
in structure or in execution. 


ered a wide geo- 
Large expenditures of money were involved, and 
each study was financed by grants from large philanthropic founda- 
tions. Professional workers in education should be familiar with 
these studies as well as with research projects now in progress. 

The first study presented, really a series of four related studies 
known as the Terman Genetic Studies 
methods of survey, case study, historical analysis, and follow-up. 
The second, commonly known as the Hartshorne and May Studies 
in Deceit, illustrates the experi 


imental and descriptive methods of 
research. The third, known as the Eight-Year Study of the Pro- 
gressive Education Association, employs the causal-comnazative 
method of analysis. 


of Genius, employs the 


The author has taken the liberty of paraphrasing and condensing 
the reports of the researchers, trusting that the summaries are valid, 


Students of educational research are urged to study carefully the 
published reports in their entirety. 


GENETIC STUDIES OF GENIUS 


One of the most si 


gnificant psycholo 
of th 


SOME SIGNIFICANT RESEARCH STUDIES 285 


sity under the direction of Lewis M. Terman. These investigations, 
spanning a period of twenty-five years (1921-1946), have been 
described in the series entitled Genetic Studies of Genius, pub- 
lished in four volumes. Each volume describes a specific phase of 
the investigation. i 
: Before 1921, no large group of g 
intensively. Terman referred to this fiel 
education, an area where positive knowledge of physical, mental, 
and personality traits of gifted children was so limited that sound 
educational procedures could not be planned. E 
In preparing these investigations five criteria or goals were 
agreed upon: 
1. Subjects selected for study sho 
ple of their kind. 
d 2. Procedures should be as objective as 
efined that the investigation could be repeate 
checked, 
Ns The subjects should be followed aj closely: 
ife as finances and other circumstances would 
4. A study should be made of the childhood of a representative 
group of historical geniuses. 
5. The investigation should not be a direct attack on the methods 
i teaching gifted children, but a search for facts that would help 
Y provide a basis for special training in the education of the 
gifted. 
S the Terman series of four published s 
E clasely linked. Vol. I carefully ana 
m racter, and personality traits of one thousa 
Wn and IV followed up the same group, after 
enty-five years, respectively. . 


ifted children had been studied 
d as the darkest Africa of 


uld represent an unbiased sam- 


possible, and so clearly 
d and conclusions 


and as far into adult 
permit. 


tudies Vols. I, II, and 
lyzes the intellectual, 
nd gifted children. 
periods of six and 


Mental and Physical Traits of a Thousand 
pilted Children, Vol. I, (1926), 648 pp4 Catherine M. Cox, The Early Mental 
Tee ee Hundred Gapiin S Ppi: (1926), 842 pp.; Barbara S. Burks, 
Studi a W. Jensen, and Lewis M. Terman, The Promise of Youth: Follow-Up 

cud of a Thousand Gifted Children, Vol. II (1930), 508 pp.; Lewis M. 
Foll, an and Melita H. Oden, The Gifted Child Grows Up: Twenty-five Years 
of ee of a Superior Group, Vol. IV (1947), 448 pp- all in Genetic Studies 
beset s, (4 Vols.) (Stanford, Cal.: Stanford University Press). Used with 

ission of the publisher. 


1 
Terman, Lewis M. et al, The 
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Study II is, in a sense, parenthetical, having no direct EOS to 
the other three. It deals with gifted children, however, approaching 
the analysis from another direction. Using historical data as evi- 
dence, the study goes back to the childhood and youth of three 
hundred individuals who achieved eminence as adults, This study 
attempted to find the answer to the question, ^What evidences of 
precocity or genius were revealed in the early lives of these three 
hundred outstanding historic personalities?" 

Each study will be described briefly, pointing out the purposes, 
procedures, and significant conclusions reached. 


l. The mental and physical traits of a thousand gifted children? 


Financed by grants totaling over $50,000 from the Commonwealth 
Fund and from Stanford University, Dr, Terman proposed an 
intensive study of the top one per cent of the public school popu- 
lation of a number of cities and rural areas in Central California. 

Because of the tremendous cost involved, it would have been 
impracticable to test al] school-age children in order to find a group 
of subjects representative of all the gifted children in the area. A 


S were asked to nominate children for 


possible selection in the following order: 


l. Brightest child in the room 
2. Second brightest 

3. Third brightest 

4. Youngest child 


5. Brightest child in the Previous year's class: ^ 
Using these nominations in mo 
and adjacent rural areas, Stanfor. 


H 


re than twenty California cities 
d-Binet tests of intelligence were 


estimated to be the appropriate cut-off leve] for selection. The 
standard was later modified, however, to include some students with 
measured intelligence quotients above 132, whose ages exceeded 


2 Lewis M. Terman et al., op. cit. 
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A Md is E was discovered that the brightest children over 
S B of age were rated too low by the Stanford-Binet Scale. 
soos E to those nominated by their classroom teachers, a 
m ntia number of gifted subjects were located through previous 
st records, special recommendations, and other sources. 
E eae groups were established. The main ex- 
mm des group consisted of 643 gifted children in grades one 
De à eight. The second group, for which less data were col- 
OMM ME am 356 gifted students residing in cities outside the 
a area of the main survey. A third experimental group 
M 378 gifted high school students, and à fourth. included 
e ch number of pupils selected because of their special ability 
areas as art and music. 

To serve as a basis for comparison, 
Er of about 800 nonselected students, 
i 5 used. A great deal of data were ga 

e study, including the following: ? 


l Intelligence as measured by the, 
National Intelligence Test, Form B. 
2. A two-hour battery of educa 
d dn A fifty-minute test of general information 
ature, and the arts. 

4. A fifty-minute questionnaire test of int 
edge of, play, games, and amusements. 

5. A four-page interest blank filled out by the pupils. 

6. A‘two-month reading record kept by the pupils. 

T. A'sixteen-page home information blank filled out by the 
parents. Such vital statistics as parents’ age, race, nationality, occu- 
pation, education, income, family size, and eminent relatives Were 
included, Parents also rated their child on. twenty-five character 


traits. 
8. An eight-page school information blank filled out by the 
teacher, including ratings on the same twenty-five traits evaluated 


by the parents. 


data gathered from a control 
attending the same schools, 
thered for the individuals 


Stanford-Binet Test and the 


tional achievement tests. 
in science, history, 


and knowl- 


erest in, 


3 Ibid., p. 7. 
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9. Home and neighborhood ratings by field assistants as scored 
on the Whittier Scale for Grading Home Conditions, and a scale for 
rating neighborhoods, 

10. Medical data gathered from health records and health infor- 
mation supplied by parents on the home information blank, Each 
child was also examined periodically by a staff of qualified medical 
examiners, Thirty-seven anthropometric measurements were taken 
of each child. Such measurements as height, length, width, or 
circumference of limbs, head and chest measurements, strength of 
grip, breathing capacity, and weight were carefully recorded. 

About one hundred pages of data were collected for each child, 
including sixty-five Pages of test and measurement data, and thirty- 
five pages of questionnaire data. The conclusions reached in this 
study resulted from the comparisons of data from the gifted or 
experimental groups with data from the control, or nongifted, 
groups. It should be noted that the differences described are dif- 
ferences between Sroups as revealed by measures of central tend- 
ency. The researchers pointed out that there was a great lack of 


particular individuals, The 
whole, evinced the following cl 
1. Physical superiori 
group. 
2. Acceleration in school. 
one or more half-grades, 
3. Fondness for school. 
in subject matter mastery, 


haracteristics: 
ty in all respects to the control or nongifted 


Eighty-five per cent were accelerated 


They demonstrated marked superiority 
as measured by achievement tests. 
4. More interest in school subjects that are abstract (literature- 
science-mathematics ), and less interest in the “so-called” practical 
subjects ( penmanship, manual training, sewing), 

5. Many-sided interest. One and three-quarters times as many 

gifted as control children had made hobby collections, and more 
than twice as many had made collections of a scientific nature, 
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6. Reading interests surpassing those of the nongifted group 
both in amount and in quality. The gifted group read more sci- 
ence, biography, travel, folk tales, informational fiction, and poetry; 
fewer books of adventure, mystery, and emotional fiction than the 
control group. The gifted child of seven read more books than 
the nongifted child read at any age to fifteen years. 

7. Choice of older playmates than the nongifted. Gifted boys, 
while they showed less interest in competitive games, showed a 
higher masculinity index than that of control boys to age thirteen: 

8. Decisive superiority over nongifted children in character 
and personality test scores in such traits as honesty, trustworthiness, 
modesty, moral judgment, and emotional stability. 

9, Earlier maturation. On the average, they walked one month 
earlier and talked three and one-half months earlier than the non- 
gifted. Characteristics of gifted children first noticed by parents 
were quick understanding, insatiable curiosity, an extensive store of 
information, retentive memory, early speech, and unusual vocabu- 
lary. Nearly one-half cf the gifted group had learned to read before 
starting school. 

10. A home cultural level that was above average, but there was 
no evidence that their superiority was the product of deliberate 
parent stimulation. . 

As a result o£ this investigation, the researchers concluded that 
there was no evidence that intellectual superiority was offset by 
inferiority in nonintellectual areas. Gifted children, as a group, 
revealed, superiority in all of the qualities that were investigated 


and meagured. 
ll. The early mental traits of three hundred geniuses* 


The second phase of the Genetic Studies of Genius series deals 
with the study of 301 men and women of great historical eminence, 
to discover the degree of mental endowment that characterized 
these individuals in their childhood, youth, and young adulthood. 

The researchers established three criteria for the selection of 
these individuals: (1) they should be individuals of unquestioned 


* Catherine M. Cox, op. cit. 
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greatness; (2) their eminence should be based upon real achieve- 
ment, not upon accident of birth or luck; (3) adequate records of 
their early lives should be available. 

The period of 1450 to 1850 was selected—three centuries for 
which records were likely to be reasonably adequate, yet long 
enough past to enable the passage of time to sift the truly great 
from those who merely appeared to be great or who had won only 
temporary recognition. 

The subjects selected for careful study were chosen from Cat- 
tells list of 1,000 Most Eminent Men of History. These men and 
women represented sixteen different nationalities and many fields 
of activity, and included in their number novelists, poets, historians, 
essayists, politicians, statesmen, scientists, soldiers, religious leaders, 
philosophers, artists, musicians, and revolutionary statesmen. 

An individual case history was compiled for each eminent per- 
son using the method of research known as historiometry, the ap- 
plication of psychometric measures of personal traits based upon 
the historical evidence gathered from primary and some secondary 
Sources of evidence. Such materials as letters, essays, poems, and 
diaries written by the subject, records of reading, school reports, 
and statements of parents, friends, and contemporaries were ac- 
cepted as primary sourcés. Biographical materials written by com- 
petent historians and biographers were accepted as secondary 
sources of evidence. 

Using these data, a panel of from three to five expert psycholo- 


gists estimated two separate intelligence quotients for each: 


eminent 
person, 


one based upon the data covering the period of easly child- 
hood and youth to the age of seventeen, and the other 
the period to age twenty-six, 
independently by the panel on 
traits, 


The composite estimates of the raters comprised an estimated 
LQ. score for each subject. It should be mentioned that each 
rater was a psychologist with a great deal of experience in the 
observation and testing of children and youth, knowing well the 
characteristics of young People of various levels of measured intelli 


covering 
In addition, each subject was rated 
Sixty-seven character or personality 
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gence. Cox mentions the fact that the independent “estimates fur- 
nished by the raters showed a degree of agreement that should free 
pm from the suspicion of being greatly influenced by personal 

jas," 5 

The mass of historiometric data, based upon evidences of the 
youthful behavior of these eminent individuals, points to three 
general conclusions: 

1. Not only was there evidence of above-average heredity, they 
also enjoyed superior environmental advantages. 

2, Their childhood behavior indicates that they possessed unusu- 
ally high I.Q.’s. The mean L.Q. score for the group was probably 
between 155 and 165. Many scored above the 200 mark. 

3. As a result of the analysis of other personality and character 
traits, there is evidence that these three hundred geniuses, even in 
childhood, displayed not only high intellectual traits, but also such 
qualities as persistence of motive and effort, confidence in their 
abilities, and great strength or force of character. 

T 
> 


Ill. The promise of youth ? 


The report in Vol. III is a follow-up study describing the status 
of the gifted group after a period of six years. The purpose of the 
follow-up study was to check on the correctness of some of the 
conclusions, and to obtain some evidence to supplement the data 
revealed in the original study of gifted children. Information was 
obtaingd regarding nearly 97 per cent of the gifted group studied 
in 192199, 

The method of data gathering was simi 
Study, Follow-up tests of intelligence, 
personality were administered, supplemente 
information blanks filled out by teachers, parents, 
themselves, Field workers conducted personal inte 
parents, children, and their teachers. While the researchers recog- 
nized the desirability of getting more complete data than was por 


lar to that of the original 
school ‘achievement, and 
d.by data obtained from 
and the children 
rviews with the 


Š Ibid., p. viii. , 
Barbara Stoddard Burks, Dortha W. Jensen and Lewis M. Terman, op. cit. 
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sible because of limitations of time and funds, they reported that 
the data were complete enough to warrant reasonably conclusive 
findings. 


‘SIGNIFICANT CONCLUSIONS 


While the gifted group continued to display superiority, as indi- 
cated by intelligence tests scores, there was a slight drop in average 
1.Q., the boys averaging a drop of three points, and the girls an 
average drop of thirteen points. The report concludes that changes 
in ability found over a period of time are possibly due to change- 
of-rate factors, and that such factors are correlated with sex. Boys 
are more likely than girls to have a high LQ. as they advance 
in age, and are more likely than girls to retain a high I.Q. earlier 
evidenced. Both boys and girls of the gifted group were more 
accelerated in school than they were in the original survey. 

The gifted group, as a whole, was relatively superior and rela- 
tively weak in the same school subjects as în 1921-99, The girls 
were relatively superior to boys in English and art, while the boys 
were better in science and mathematics, 

In achievement, as measured by the Stanford Achievement Tests, 
the girls tended to score relatively higher than the boys, in terms 
of what would be predicted from an analysis of their intelligence 


quotients. A similar superiority of girls over boys in average 
school marks received was also noted. 
Gifted boys and girls tended to 
time activities, while collectin 
declined after age fourteen, 


prefer reading to all other leisure- 
g interests for both boys and girls 


The gifted group, as a whole, con- 
tinued to maintain its active participation in social as well as in- 


tellectual activities. The gifted subjects showed an even greater 
tendency to prefer companions older than themselves, and continued 
to display superior behavior and personality patterns. 

Ninety-four per cent of the boys and 91 per cent of the girls had 
gone or had plans to go to college. About three times as many 
members of the gifted group were elected to Phi Beta Kappa as 
were other seniors at Stanford and the University of California. 
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Those that married tended to choose a spouse who had about a year 
less schooling and, in the majority of cases, who was less well- 
endowed intellectually. 

As a general conclusion, it was reported that the composite picture 
of the gifted group had changed only in minor respects in six years. 


IV. The gifted child grows up? 


Part IV of the Genetic Studies of Genius series presents a picture 
of Terman’s original group of gifted children after a period of 
twenty-five years. The data presented in this report are the product 
of follow-up studies carried on in 1936, 1940, and 1945. By 1945 
the average age of the group was thirty-five, a period when adult 
careers clearly take form. This longitudinal type of study, cover- 
ing a quarter of a century, enabled the researchers to follow a group 
of gifted individuals from childhood to adulthood, and to evaluate 
some of the influences of “giftedness” upon their development as 
creative contributors tc society. 3 

The additional data collected in the follow-up studies were 
gathered through personal interviews or by mail, through four-page 
information blanks filled out by each subject and by parents or rela- 
tives, the Strong Vocational Interest Test, a concept-mastery test, 
a marriage blank for both gifted subjects and their spouses, a per- 
sonality and temperament test, and a Stanford-Binet Test of the 
subject’s offspring above the age of two-and-a-half years, together 
with birth and developmental data on each child. In addition to 
the data. mentioned, field workers made detailed reports based on 
their conversations with the subjects, their parents, their spouses, or 
other relatives. The researchers reported that the subjects were 
most cooperative, going to almost any lengths to aid in the conduct 
of the investigation. 

Through the use of punched cards and machine tabulation, a 
thorough analysis of the great mass of data collected was accom- 
plished. The completeness of the follow-up studies is attested by 
the fact that data were secured for 97.7 per cent of the 1,467 living 


7 Lewis M. Terman and Melita H. Oden, op. cit. 
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subjects. While it would be inappropriate to attempt to summarize 
all of the findings of the studies, a few general conclusions are 
presented: 

1. The health of the adult subjects was considerably superior to 
that of the general population. They excelled in stature and in 
freedom from serious defects, and showed a more favorable mor- 
tality rate than the general population of comparable age. In 
mental health and general adjustment the gifted group excelled the 
general popülation. 

v2. The incidence of delinquency was below that of the general 
population. Only four subjects served terms in penal institutions, 
three as juvenile offenders and one as an adult. The one adult, 
whose measured childhood intelligence quotient was 154, was sen- 


tenced to prison for forgery. It is noted that he was a model 
prisoner, and soon became editor of th 


3. As judged by the concept- 
there seems to have been evi 


€ prison newspaper. 

mastery test given the adult group, 
dence of a small mean decrease in 
mental function, which after, correction for errors of measurement, 
may have been less than five 1.Q. points. 

4. Of the approximately 90 per cent of the men who entered col- 
lege, 70 per cent graduated; of the 80 per cent of the women enter- 
ing, 67 per cent graduated. The proportion of college graduates 
who completed advanced degrees was 51 per cent of the men and 
29 per cent of the women, F orty per cent of the men and about 
32 per cent of the women graduated from college with honors. 
Both men and women of the gifted group participated to s greater 
extent in extra-curricular activities than college students jin general. 

5. In occupational status, approximately 71 per cent of the gifted 
men were individual or executive workers and, regardless of educa- 
tion, appeared to be assuming responsibility and leadership in far 
greater proportion than college graduates in general. Forty-five 
per cent of the gifted men were in professions, eight times as high 
a proportion as that of California males in general, 

6. In voting regularly the gifted group excelled the electorate 
in general, with 91 per cent voting in national elections. 
7. Gifted subjects tended to choose spouses who were less gifted, 
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but who possessed intelligence equal to that of the average college 
graduate. 

8. The mean intelligence quotient of the offspring who were 
given the Stanford-Binet Test was 128, a little below the average 
of their gifted parents. There were few cases of feeblemindedness 
and border-line mentality, however, and a high proportion of intelli- 
gence quotients of 150 or higher among the offspring of the gifted 
group. c 
In summary, it was discovered that gifted children grow up to 
be gifted and successful adults, maintaining their superiority in 
practically every trait and area of endeavor. The study is con- 
cluded with a series of important plans and proposals for continued 
investigation which should add much to this important area of 
human knowledge. 


THE CHARACTER EDUCATION INQUIRY ° 


The Character Education Inquiry came about as a result of the 
proposals of three organizations: the Religious Education Associa- 
tion, the Committee on Curriculum of the International Lessons 
Committee, and the Bureau of Research of the International Council 
of Religious Education. Each of the organizations petitioned the 
Institute of Social and Religious Research for funds to carry out a 
study in the area of character and religious education. 

The Institute assumed the leadership and called together twelve 
specialists in religious and general education to plan a study. A 
committee of twelve proposed the following recommendations: ° 
ences of children which have moral and 


for perióds of time, of the 
youth, and adults 


]. Study the actual experi 
religious significance, and the effects, 


moral and religious influences to which children, 


have been exposed. 
2. Apply the objective methods o 
of conduct under controlled conditions. 


f the laboratory to the measurement 


udies in Deceit, Vol. I, (New York: 


8 Hugh Hartshorne and Mark A. May, St: 
permission of the author, Dr. 


The Macmillan Co., 1928). 306 pp. Used by 


Mark A. May. 
9 Ibid., p. vi. 
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ca 


Engage one or more full-time investigators and associate with them 
advisors and assistants. 


4. Secure collaboration by various institutions and groups. * 


5. Make the results of the study available in both technical and popu-, 


Dr. Hugh Hartshorne, Professor of Religious Education at the Uni- 
versity of Southern California, and Dr. Mark A. May, Professor of 
Psychology at Syracuse University, were designated as codirectors 
of the five-year study. Dr. Edward L, Thorndike of Columbia 


In order to standardize the metho 
Possible variables had to be contro 
classroom teachers, carefully train 


d of test administration certain 
lled. Instead of using regular 
ed examiners administered all 
10 Ibid., p. 47. 
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of the tests, using standardized procedures. Rotational procedures 
were employed to minimize the influence of difficult-to-control, 
extraneous factors. : 

Tests were administered in both public and private institutions 
to 10,865 students in grades one through twelve. In selecting 
school populations for study an attempt was made to use representa- 
tive samples varied as to Social economic, and cultural levels, 
degrees of intelligence, ethnic and racial groupings, occupations, 
religions, groups, siblings, and sex. This variety of subjects made 
it possible, through statistical techniques of correlation, to relate 
dishonesty or deceit to such factors as those mentioned, Sunday 
School attendance, and type of religious instruction. 

No attempt is made here to describe all of the twenty-nine test 
procedures used in the experiment. Several are described to illus- 
trate the nature of the experiments, and to demonstrate how be- 
havior may be subjected to scientific investigation. 


Tests for measuring chaating 


The double-testing technique. This procedure consisted of giv- 
ing a test and letting the students correct their own papers against 
an answer key furnished them. Then an equivalent form of the 
test was given, but this time scored by the examiner. Any differ- 
ence in scores would be attributed to the dishonest scoring that 
resulted from changing responses or copying missing answers from 
the key. 

Another variation consisted of giving a test, collecting it, and 
recording the scores. Then, a day or two later, the same test was 
returned with the comment, “We're going to let you score your own 
tests using this key.” The difference between the score recorded 
by the examiner and the student's self-scoring, if any, could be 
assumed to be the result of cheating. 

Improbable-achievement technique. This process consists of giv- 
ing a test under such conditions that achievement above a certain 
level would indicate deception. A number of variations were used. 
Given a sheet of paper with a number of printed circles, the student 
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was asked to close his eyes, and see how many dots he could place 
inside the circles in a limited period of time. Beyond a certain 
number that could be accounted for by chance, an excessive num- 
ber of dots in the circles would provide evidence of peeping. 

Another variation consisted of a small open box containing fifteen 
small blocks, numbered one to fifteen. The students were in- 
structed to slide the numbered blocks so that a particular order 
would be achieved. They were instructed not to lift them out. 
Then, in a limited period of time the students were asked to arrange 
the blocks in an order which was impossible to achieve without 

lifting. Thus, a perfect arrangement could be made only by cheat- 
ing. 

Another variation involved a problem of weight discrimination. 
Seven small pill boxes were filled with cotton and buckshot so that 
no two weighed exactly the same. They were numbered on the 
bottom from one through seven, in order of weight. The students 
were asked to arrange the boxes in order from lightest to heaviest, 
without looking at the numbers on the bottoms. Since the weight 
differences were too slight to be detected, no one could arrange 
them in order without looking at the bottoms, except by chance. 
Three minutes were given for each of two trials, and a correct 
solution was assumed to be the result of peeping. The combina- 
tions that were least likely to occur by chance were given the larger 
cheating scores, and vice-versa. 

Athletic contests. Deceptive behavior in athletics was detected 
by using four types of activity. Pupils were encouraged to com- 
pete in contests of hand-grip, as measured by a dynameter, lung 
capacity, as measured by a spirometer, the pull-up or chinning test, 
and the standing broad jump. After instructions in how to read 
the instruments, students were asked to record their best scores on 
four trials. Within limits previously established as fatigue margins, 
the difference between the student’s self-recorded best performance 
and his best performance as recorded by an examiner indicated rela- 
tive honesty or dishonesty in reporting. 

Competitive party games and other devices were employed to 
measure cheating, using much the same types of procedure. 
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Tests for measuring stealing 


. Several tests were designed to determine whether or not chil- 
dren would take money if they thought they could not be observed 
or that the coins would not be missed. These tests involved coin 
puzzles with extra coins, ostensibly belonging to another puzzle, 
in the puzzle box. The evidence of deception was in not returning 
the extra coin when the puzzle box was returned. c 


Methods for measuring lying 


This procedure consisted of asking students questions about facts 
known to the examiner. Where students had cheated on previous 
tests, but denied it on a questionnaire, there was clear evidence of 
lying in addition to cheating. 

For those who had not cheated on previous tests, the "lying to 
win approval" technique was employed. Students were asked 
whether or not they had done things that have social approval but 
are, nevertheless, rarely done. Negative answers to such questions 
as "Have you ever been rude to the teacher?" or "Do you ever act 
greedily by taking more than your share of anything?" or affirmative 
responses to such questions as "Do you always smile when things 
go wrong?" or “Do you always obey your parents cheerfully?" are 
examples of lying. This is much the same type of item which is 
used to determine the lie factor in several well-known personality 
scales. 

The examples presented are but a few of the tests used in the 
investigation. The researchers are careful to explain that they 
make no sweeping claims. In their words: !! 


In the Introduction we warned the reader against assuming that when 
we have only tested conduct, even in a large number of situations, we 
have thereby tested character. We have not. Our tests of deception 
are not, as they stand, tests of character. All we have is a series of 
records of specific acts. Even when these records are highly prophetic 


11 Jbid., p. 146. 
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of future acts of the same sort, they are not to be taken as quantitative 
descriptions of character. 


With these limitations in mind, the investigators did arrive at a 
number of conclusions as a result of the study. 

Deceit in one form or another is definitely associated with such 
factors as low intelligence, retardation in school, emotional insta- 
bility, low socio-economic status, frequent attendance at movies, 
other behavior difficulties in school, and certain racial and religious 
influences. 

The researchers conclude that students resemble friends and close 
associates in their tendency to deceive. 


less deception among students in progress 
more conventional scho 
friendliness and good w; 
tion. Students who had 
cheated more than thos 
the intelligence factor w 


They found evidence of 
ive schools than those in 
ols. When there was an atmosphere of 
ill in the classroom, there was less decep- 
little ability to pass their tests successfully 
e who were able to do well. Even when 


tive behavior. Ther 
stealing, and lying 
motive or desire to 
honest behavior. 


THE EIGHT YEAR STUDY :2 


In 1932 a number of leading colleges and universities agreed to 
a proposal of the Commission on the Relation of School and College 
of the Progressive Education Association to participate in a bold 
experiment. The colleges agreed to accept students from a group 
of thirty selected secondary schools without 


entrance examinations 
and without regard to the pattern of course r 


equirements ordinarily 


12 Dean Chamberlin, et al, Did They Succeed in College? (New York: 
Harper & Brothers, 1942). 291 pp. Used by permission of McGraw-Hill Book 
Company, Inc., present copyright owner. 
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required for admission. The only requirements for admission were 
to be the recommendation of the principal, a complete record of the 
students academic and extra-class activities, and his scores on 
scholastic aptitude and achievement tests given during the second- 
ary school course. € 

The Progressive Education Association was concerned with better 
ways of setting up the secondary school curriculum. Freed from 
the traditional college entrance requirements, schools would then 
be able to build the type of curriculum they believed to be best. 
In the words of Max McConn in his preface to one of the published 
reports: 1 


Is the traditional college entrance program the only safe and sound plan 
of preparation for college? Or can boys and girls be equally weil, or 
even possibly better prepared for college through a considerable variety 
of widely different programs devised by competent sccondary school 
teachers with their eyes fixed primarily on the conditions and demands of 
modern life, and the individual capacities and interests of particular stu- 
dents, with only incidentz] reference to the impending college experience? 
Would students coming up through such a heterogeneous system be able 
to hold their own in a major college or would they be foredoomed to fail- 


ure? S 


The hypothesis of the Commission on the Relation of School and 
College was that there are other ways of successfully preparing 
youth for college. 

Selected to participate in the study were thirty secondary schools, 
public ánd private, large and small, and representing different geo- 
graphic ‘sections of the United States, The curriculum patterns 
were in no sense standardized. Each school was free to develop 
the type of courses and experiences it felt would best provide for 
the educational needs of its students. No two schools developed 
identical programs. Some introduced new courses, some com- 
bined existing courses, and others modified teaching-learning pro- 
cedures within existing courses. Some set up a core curriculum, 
others emphasized the problems approach in more conventional 


18 Ibid., p. xix. 
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courses. Broad field organization characterized some programs, 
others introduced correlated or fused courses. 

While the programs of the thirty schools were of widely differ- 
ing patterns, they did have Something basic in common. They 
emphasized teachcr-pupil planning, laboratory-type learning experi- 
ences, democratic procedures, and the problem-solving approach 
to learning. They were also uninhibited by the usual restrictions 
of course unit requirements found in conventional secondary school 
programs. 

In 1932 students in the thirty schools began to pursue experi- 
mental-type programs. By 1936 they were ready for college, and 
by 1940 the first class had completed the four-year college pro- 
gram. The results of the study are based upon those students 
who entered college in 1936 and who graduated in 1940, those who 


entered in 1937 for three college years, in 1938 for two college years, 
and in 1939 for one year in college. 


Plan of the study j 

The experimental plan consisted of m 
of the thirty experimental schools wi 
high school, both of whom were e 


record, size of secondary school attende 


educational colleges and universities. 

In the comparison 1,475 matched 
an experimental group and a cont 
careers, the students in the ex 
students in the control group 
college: 


pairs were selected, making up 
rol group. During their college 
perimental group were compared with 


on the following criteria of Success in 


1. Intellectual competence 
point average, honors, prizes, 
intellectual activities beyond cou 


as determined by academic- 
and manifestation of inter 
rse requirements, 


grade 
est in 
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2. Cultural development and the use of leisure for worthy activi- 
ties—concerts, theater, writing, art, athletics, hobbies, and participa- 
tion in social, religious, and service-type activities. 

3. Practical competence, as revealed by evidence of manual skills, 
common-sense judgment, and ability to adapt to situations, to budget 
time and money wisely, and to obtain and hold a job. 

4. Philosophy of life, vocational objectives, ethical standards, and 
ideals. ; 

5. Emotional balance, as revealed by independence and atti- 
tudes toward parents and others. 

6. Social fitness—the ability to make and keep friends, evidence 
of poise, and social skills. 

7. Sensitivity to social problems—concern about social and eco- 
nomic problems on the campus and in the world at large, and will- 
ingness to assume citizenship responsibilities. 

8. Physical fitness—health habits developed and physical activities 
engaged in. 


To measure these qualities and competencies for comparative pur- 
poses, many types of evidence were employed: 


1. Course grades 

2. Reports from instructors, advisors, counselors, residence hall 
heads, and activity supervisors 

3. Special tests designed for the study 

4. Questionnaires 

5. Health reports 

6. Interviews with the student 

T. Reading and activity records 

8. Samples of written work 

9. Other college records 


Conclusions 


A comparison of the 1,475 matched pairs of graduates of the 
thirty schools and the conventional high schools reveals the fol- 
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lowing characteristics of the experimental students or graduates of 
the thirty schools: !* 


1. They earned a slightly higher grade point average in all sub- 
jects except the foreign languages. They received slightly more 
academic honors, and a higher percentage of nonacademic honors. 

2. They were more often judged to possess intellectual curiosity 
and drive, and to be precise, Systematic, and objective in their 
thinking. They were also more often judged to demonstrate a high 
degree of resourcefulness in meeting new situations. 

3. They did not differ from the comparison group in number of 
times on probation, in ability to plan their time wisely, or in the 
quality of adjustment to their contemporaries. 

4. They participated more fre 
appreciative experiences in the 

organized student activities, 
nature, 


quently and more often enjoyed 
arts, and participated more in all 
except those of a religious or service 


5. They were more often judged to have developed clear ideas 


about the meaning of education, a better orientation towards the 
choice of a vocation, and a more active.concern for what was going 
on in the world. 


While some of these differences were 
sistent. It is apparent that the graduates 
more successful than graduates of the con 
as judged by college standards, their con 
dents themselves, 

As an additional feature of the study, a special analysis was made 
of the graduates of the six schools that 


departed most from tradition 
with the graduates of the six that departed least. The graduates 
of the most experimental schools showed a marked superiority over 


those from the least experimental schools, the difference being even 
greater than that existing between the graduates of the total thirty 
schools and those of the conventional high schools, 
‘In this experiment a slight 
tween the graduates of the 


not great, they were con- 
of the thirty schools were 
ventional schools, whether 
temporaries, or by the stu- 


advantage or even no difference be- 
thirty schools and the conventional 
14 Ibid., p. 207-208, 
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schools would have supported the hypothesis that there is no pre- 
scribed course pattern that best prepares a student for college, and 
that students are not subjected to the risk of college failure when 
secondary school teachers and administrators depart from tradi- 
tional course requirements. 

It is interesting to note that the conclusions reached by the Eight 
Year Study have apparently had a marked influence upon entrance 
requirements in American colleges and universities. 


SUMMARY 


Three noteworthy research studies in the field of education have 
been briefly described. Each study deals with an important educa- 
tional problem, follows an expertly designed plan, carefully gathers 
and analyzes data, and objectively interprets and reports conclu- 
sions. 
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217 
Reliability of tests, 177-178, 243 
Religion, 1-2 
Religious education, character and, 
295-300 
Religious 
295 
Reports, writing of, in historical re- 
search, 95-96 
Requirements for Certification of 
Teachers . . « Woellmer and 
Wood, eds., 59 
Research, academic (see Educational 
Tesearch) 
action, 9-11 
characteristics of, 7-8, 16-17 
definition of, 6 
fundamental, 8-11 
meaning of, 1-14 
motivation, 112 
scientific method and, 6 
tools of, 140-186 


Education Association, 


Research, academic (Cont.) : . 
(See also kind of research, as His- 
torical research) 
Research projects, academic, 17-18 
list of topics for, 26-28 
preparation of agendum for, 22-25 
Progress reports on, 25-26 
Research proposal, preparation of, 22— 
25 


Research reports, 249-250 
chapter headings in, 268-269 
evaluation of, 278-281, 307 
figures in, 272-278 
footnotes in, 259268 
format of, 250-256 
pagination of, 269 
reference materials for, 255-256 
style of writing for, 256-257 
tables in, 270—272 
typing of, 258 
typography for, 258-259 
Research Studies, significant, 283-305 
Research Studies in Education, Brown 
and Lyda, eds., 45 
Reserve books, use of, 32 
Review of Educational Research, 49, 
179 
Roge"s Thesaurus of Words and 
Phrases, 68 
Rotational methods in classroom re- 
search, 134—137 
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Salk vaccine, 128-129 
Samples, simple random, 204—205 
stratified, 205-206 

San Francisco State College, 132 

Scaled Specimens, 166 

Scattergrams, 23 1-232 

Schedules, 142-143 

School Law, Remmlein, 75 

School Law of the 48 States, Huston, 74 

School Law of Indiana, 75 

School law reference books, 73-77 

School law research, 96-99 

School Review, 44 

School surveys, 109-110 

School Teacher's Day in Court, 74 

Schoolman's A Imanac, 59 

Schools, experimental, in relation to 
colleges, 300—305 
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Science, birth of, 2 
meaning of, 4 
(See also Physical science; Social 
science) 
Scientific method, development of, 2— 
4 
research and, 6 
Scientific Social Surveys and Research, 
Young, 167 n. 
Score cards, 165-166 
Seagoe, May V., 120 
See, Harold W., 152 
Shaw, Clifford R., 108 
Shephard's Citations to Statutes, 77 
Sherman, Mandel, 114 
Sigma score (small z), 219-220 
Single variable, law of the, 126 
Slide rules, 210 
Social-distance scale, 182—183 
Social research, terms used in, 103 
Social sciences, 4—6 
Social surveys, 108—109 
Societies, publications of, form for 
citing, 264-265 
Sociograms, 180—182 
illustration of, 181 
Sociometry, 180-182 : 
Sources of data, 88-89 
primary, 89 
secondary, 89—90 
Southeastern Reporter, 77 
Southern California, University of, 
183 
Southern Reporter, 77 
Southwestern Reporter, 77 
Soviet Union, scientific education in, 
19-20 
Spearman Rank Order Method, 234 
Sponsorship for questionnaires, 153 
Spread, measures of, 216 
Standard deviation (s), 218-219 
Standard score (large Z), 220 
Stanford Achievement Tests, 292 
Stanford-Binet tests of intelligence, 
286-287, 293, 295 
Stanford University, 284—286 
Stanine or sta(ndard) nine-point scale, 
228-230 
State Law Index, 73 
State Laws on Race and Color, Mur- 
ray, 75 
Statesman's Yearbook, 59 
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Statistical Abstract of the United 
States, 58-59 
Statistical calculation, aids to, 209-211 
Statistical estimates, 226 
Statistical measures, 211 
Statistical tables, 210 
Statistics, 195-198 
caution in uself, 243-245 
definition of, 202—203 
descriptive, 203 
inferential, 203-204 
Statutory law, 97 
Stealing, tests for measuring, 299 
Stratified samples, 205-206 
Strong Vocational Interest Test, 293 
Studies, descriptive research, 102-122 
Studies in Deceit, Hartshorne and 
May, 284, 295 n. 
Studies in Service and Self-Control, 
Hartshorne and May, 182 n. 
Study Abroad, 62 
Style manuals, 250 
Subject Guide to Books in Print, 43 
Subject Guide to United States Publi- 
cations, Hirshberg and Melinat, 
72 
Sukenik, Professor, 93 
Summary of Doctoral Dissertations, 


Supreme Court Reporter, 77 
Surveys, 106-107 
market, 111—112 
public-opinion, 110—111 
school, 109-110 
social, 108-109 
Syllogisms, 2 
Synthesis of data, 95 
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t tests, 227 
Tables, 270-272 
construction of, 195 
footnotes to, 271—272 
Tabulating cards, 210 
Tabulating machines, 210 
Tabulation of data, 191-195, 206 
careless or incomplete, 196—197 
Television, educational, 19 
Terman, Louis M., 121, 285-287, 
293 n. 
Terman Genetic Studies of Genius, 284 
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Tests, reliability of, 243 
validity of, 242—243 
"Theses, indexes of, 45 
.references to, 267 
They Went to College, Havemann 
and West, 121 n. 
Third Mental Measurements Year- 
book, 179 i 
Thorndike, Edward L., 296 
Three-group design in classroom re- 
search, 133-134 
Thurstone, L. L., 156 n. 
Thurston Technique of Scaled Values, 
156-157 
Tie scores, ranking of, 235 
Time and motion studies, 117 
Trend studies, 121—122 
Trustees and Presidents of Ameri- 
can Colleges and Universities, 
Cook, ed., 67 
Tyler, David, 127 
Typing of research reports, 257-258 
Typography for research reports, 258— 


259 
U 
Ulrich's Periodical Directory, Groves, 
ed., 60 y 


Union List of Serials in Libraries of 
the United States and Canada, 
60 


United Nations Document Index, 47 
United States Government Publica- 
tions, Boyd and Rips, 72 

Univac, 210-211 

Universe, orderliness of, 2 

Universities of the World Outside the 
United States, Chambers, ed., 
62 


Unpublished material, 


references to, 
267 
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Validity of tests, 176-177, 242-243 
Variables, in classroom research, 129— 
130 
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Variables (Cont.): ? 
prediction of, 233 
single, 126, 129 d 

Vertical File Service Catalogue, 49 

Voting by gifted individuals, 294 ¢ 

w f 

Walker, Helen M., 208, 215 n. 

Waples, Douglas, 117 

Warner, W. Lloyd, 115 

Webster's Biographical Dictionary, 66 

Webster's New International Diction- 

ary, 68 

West, James, 114 

West, Patricia, 121 

Whittier Scale for Grading Home 

Conditions, 288 

Who Shall Survive? Moreno, 180 n. 

Who Was Who in America, 67 

Who's Who in America, 67 

Who's Who in America Current Bio- | 

graphical Reference Service, 66 

Who's Who in American Education, 

Cook, ed., 67 

Wilson, Edmund, 93 n. f 

Wilson, H. W., Company, 34 iq 

Witty, Paul, 108 

Word Finder, The, Rodale, 69 

World 24lmanac, 58 í 

World Book Encyclopedia, 55 ] 


Writing, Style of, for Tesearch reports, 
256-257 
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Yearbook of Education, Jeffery, ed., ) 
57 


Yearbook of Education, Lauwerys and l E 
others, eds., 56-57 , È: 

Yearbook of School Law, Chambers, t 
ed., 75 


Yearbook of School Law, Garber, ed., 
76 


Yearbook of the United Nations, 59 
Yearbooks, 58-64, 75-76 
Young, Pauline V., 167 n. 
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